> Global Inventory of 

Regional and National Qualifications 
Frameworks 

Volume I: 

Thematic Chapters 




UNESCO Institute 
for Lifelong Learning 


United Nations . 
Educational, Scientific and . 
Cultural Organization . 


★ * * * 
* 

i ★ 


ETF 


Working together 
Learning for life 


CeDGfOp 


European Centre for the Development 
of Vocational Training 








GLOBAL INVENTORY OF 

REGIONAL AND NATIONAL QUALIFICATIONS 

FRAMEWORKS 


Volume I: 

THEMATIC CHAPTERS 


IMPRINT 


PUBLISHED IN 2015 BY 

UNESCO Institute for Lifelong Learning 
Feldbrunnenstrasse 58 
20148 Hamburg 
Germany 


© UNESCO INSTITUTE FOR LIFELONG LEARNING (UIL), EUROPEAN TRAINING FOUNDATION (ETF) AND THE 
EUROPEAN CENTRE FOR THE DEVELOPMENT OF VOCATIONAL TRAINING (CEDEFOP). 


The UNESCO Institute for Lifelong Learning (UIL) is a non-profit international institute of UNESCO. The Institute 
undertakes research, capacity-building, networking and publication on lifelong learning with a focus on adult and 
continuing education, literacy and non-formal basic education. Its publications are a valuable resource for educa- 
tional researchers, planners, policymakers and practitioners. 

The European Training Foundation (ETF) is a European Union-funded agency that supports the development of 
vocational education and training systems in 30 neighbouring countries, known as partner countries. These include 
places that border, or are close to, European Union member states, from the Balkans and the former Soviet republics 
of central Asia to the Middle East and North Africa. The ETF's mission is to help its partner countries develop the 
skills of their populations in order to promote political stability, economic development and human rights. 

The European Centre for the Development of Vocational Training (Cedefop) is the European Union's 
reference centre for vocational education and training. It provides information on and analyses of vocational educa- 
tion and training systems, policies, research and practice. Cedefop was established in 1975 by Council Regulation 
(EEC) No 337/75. 

The selection of facts and opinions expressed in this publication are those of the authors and do not necessarily 
coincide with official positions of the United Nations Educational, Scientific and Cultural Organization (UNESCO), 
the UNESCO Institute for Lifelong Learning (UIL), the European Training Foundation (ETF) or the European Centre 
for the Development of Vocational Training (Cedefop). The designations employed and the presentation of ma- 
terial in this publication do not imply the expression of any opinion whatsoever on the part of the publishers 
concerning the legal status of any country or territory, or its authorities, or concerning the delimitations of the 
frontiers of any country or territory. 

DESIGN AND LAYOUT: Teresa Boese, Hamburg (www.titrobonbon.de) 

COVER DESIGN: Christiane Marwecki (cmgrafix communication media) 

ISBN: 978-92-820-1196-6 


CONTENTS 

INTRODUCTION 6 

VOLUME I -THEMATIC CHAPTERS 8 

Chapter 1: Between communication and transformation: 

the impact of European national qualifications frameworks 8 

Chapter 2: Links between NQFs and validation of non-formal and informal learning 18 

Chapter 3: NQF links with informal sector skills development 26 

Chapter 4: NQFs and reforming qualifications 36 

Chapter 5: Changing legal and institutional arrangements as a consequence of 

qualifications systems reforms 44 

Chapter 6: Developing world reference levels of learning outcomes: 

potential and challenges 53 


CONCLUSIONS 


Global progress in NQF development since 2013 


59 


ACKNOWLEDGEMENTS 


This Global Inventory of Qualifications Frameworks is the result of collaborative work between the European 
Training Foundation (ETF), the European Centre for the Development of Vocational Training (Cedefop), the United 
Nations Educational, Scientific and Cultural Organization (UNESCO) and the UNESCO Institute for Lifelong Learning 
(UIL). Arjen Deij and Michael Graham (ETF) and all members of the ETF qualifications team; Jens Bjornavold, 
Slava Pevec Grm, Ernesto Villalba and Hanne Christensen (Cedefop); Borhene Chakroun and Katrien Daelman 
(UNESCO); and Arne Carlsen and Madhu Singh (UIL) are the authors of the thematic chapters. This publication 
would not have been possible without the close cooperation of national and regional agencies. We are very grateful 
for the extensive help and guidance provided by national and regional experts, particularly in compiling the country 
and regional cases. 


While preparing this publication we received the sad news that David Raffe, Professor of Sociology of Education, 
University of Edinburgh, had died unexpectedly. 

For us, experts and stakeholders involved in developing and supporting qualifications systems, David's conceptu- 
alizations and analyses of qualifications systems development and reforms have been essential in understanding 
the nature and processes of these reforms and their impacts. In particular, David promoted policy learning rather 
than policy borrowing, and drew attention to questions that qualifications systems reform raised. David not only 
asked what NQFs promise, he also was keen to analyse to what extent these reforms are being implemented and 
the diversity of purposes and impacts on education and training systems. 

As an inter-agency group active in the field of qualifications systems reforms, we celebrate his life's work and what 
he has given to researchers, practitioners and decision-makers. 


6 


VOLUME I -THEMATIC CHAPTERS 


INTRODUCTION 

The context for this publication is unique in many ways. 
Firstly, the year 2015 is a landmark for the adoption 
of new Sustainable Development Goals by the United 
Nations Assembly. Education and training are at the 
heart of the post-2015 sustainable development agen- 
da and are considered essential for the success of all 
sustainable development goals. Secondly, the scale 
of qualifications framework development has reached 
an unprecedented level. Since the 2013 edition of the 
Inter-Agency Inventory on qualifications frameworks 
(QFs), at least twenty new countries have decided to 
develop a national qualifications framework (NQF). 
The total figure now exceeds 150. The United Nations 
lists 193 sovereign states, so NQF coverage extends to 
approximately three in four countries. 

Given the diversity of country contexts, it is remarkable 
how much consensus exists around the world that quali- 
fications frameworks based on learning outcomes are 
appropriate tools for the reform and expansion of edu- 
cational and training provision in ways that will raise skills 
levels, improve labour market productivity and contrib- 
ute to sustainable development. 

SCOPE OF THE INVENTORY 

The underlying premise of the Inventory follows from the 
goal of monitoring and characterizing the development of 
NQFs as implemented by member states. The Inventory 
involves both a mapping of global qualification reforms 
and thematic chapters that discuss key trends and policy 
issues emerging from qualifications framework reforms 
and development. 

This Inventory provides a broad overview of the status and 
scope of qualifications frameworks internationally as at 
the end of 2014. It includes the NQFs of eighty-six coun- 
tries and seven regional qualifications frameworks (RQFs). 
The Inventory acts as an observatory of progress and 
achievement of NQF goals through country case studies. 
Specifically, the case studies look at the main policy ob- 
jectives, stakeholder involvement, the framework adopted 
for implementation, the focus on learning outcomes and 
the use of level descriptors. They also consider the ways in 
which the validation of non-formal learning is considered (if 
any), and how these link to the NQF. The case studies finish 
with important lessons and future plans. 
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The global mapping draws on inventories from agencies 
(the European Centre for the Development of Vocational 
Training [Cedefop], the European Training Foundation 
[ETF], the United Nations Educational, Scientific and 
Cultural Organization [UNESCO] and the UNESCO 
Institute for Lifelong Learning [UIL]) and communica- 
tion with country officials and experts. It also draws on 
extensive research in the field of qualifications, as cap- 
tured in the list of countries and regions covered. In this 
regard it is important to note that several related initia- 
tives were under way at the same time as this report. 
For example, UNESCO is leading research leading about 
the use of level descriptors with an aim to develop world 
reference levels (Keevy and Chakroun, forthcoming). 
Cedefop has conducted a review of quality assurance of 
certifications (Cedefop, forthcoming). ETF has published 
a report regarding the appropriate approaches to develop 
better qualifications (ETF, 2014) and UIL has examined 
links between recognition practices and NQFs (Singh and 
Duvekot, 2013). 

THEMATIC FOCUS OF THE INVENTORY 

The Inventory shows that most countries are reform- 
ing their qualifications systems to improve the quality of 
qualifications and their relevance to the labour market and 
learner needs. As noted by Jens Bjornavold and Slava Pevec 
Grm in Chapter 1 , our overall understanding of the role and 
function of NQFs has evolved, and it is becoming increas- 
ingly clear that frameworks can combine communication 
and transformation functions and roles in different ways, 
reflecting the particular national situations and contexts. 

Another global phenomenon is the validation of non-for- 
mal and informal learning. As demonstrated by Ernesto 
Villalba and Madhu Singh in Chapter 2, the recognition of 
non-formal and informal learning can be better achieved 
through the use of NQFs based on learner outcomes, 
which can influence standards, curricula and assessment 
criteria. Through the use of these, individuals' knowledge, 
skills and competences can be referenced and understood 
by the different sectors and stakeholders of the economy 
and society at large. NQFs also constitute a source of 
quality assurance of validation processes. 

In Chapter 3, Madhu Singh explores formalizing approach- 
es linking NQFs to informal sector skills development, 
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particularly in low- and middle-income countries and 
emerging economies with large informal sectors. These 
formalizing tendencies are seen in terms of the existence 
of a system of regulated learning outcomes based quali- 
fications, opportunities for the validation of non-formal 
and informal learning, support from competent authori- 
ties and the private sector, incorporation of existing in- 
formal sector skills initiatives, and the permeability of 
education and training systems. Other drivers and levers 
are also recommended. 

In Chapter 4, Arjen Deij and Michael Graham note that 
many countries now have some or most of the necessary 
elements of a modernized qualifications system in place. 
Many have passed legislation, developed quality assur- 
ance systems to regulate the new system, and developed 
occupational standards. However, Deij and Graham ob- 
serve that in most cases NQFs remain empty of qualifi- 
cations, and universally the urgent need is to populate 
these frameworks. 


The degree of regulation is determined by historical, cultural 
and sociopolitical factors. Legislation is often required to start 
the NQF implementation, but legislation is a process conduct- 
ed in different stages, and is bound to change during the im- 
plementation. In Chapter 5, Arjen Deij and Michael Graham 
recommend that countries start the legislative process with 
broad-framework legislation, confirming the objectives, the 
levels of the NQF and general principles, but leave details to 
secondary legislation that can be more easily updated. 

Borhene Chakroun and Katrien Daelman note in Chapter 
6 that RQFs are the other type of framework emerging 
as a tool for supporting cross-border mobility of learners 
and workers, and acting as a means for fair and transpar- 
ent recognition of qualifications. Chakroun and Daelman 
present a UNESCO-driven initiative to develop a set of 
world reference levels of learning outcomes that are ex- 
pected to act as ‘generalizable indicators' of levels of 
learning and a ‘shared hierarchy that allows comparisons 
of any kind of learning' or a ‘common metric'. 
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GLOBAL INVENTORY OF NATIONAL AND 
REGIONAL QUALIFICATIONS FRAMEWORKS 


CHAPTER 1: BETWEEN COMMUNICATION AND 
TRANSFORMATION: THE IMPACT OF EUROPEAN NATIONAL 
QUALIFICATIONS FRAMEWORKS 


INTRODUCTION 

Before 2005 national qualifications frameworks (NQF) 
had been set up in three European countries: France, 
Ireland and the United Kingdom. By 2015, frameworks 
had been introduced in all thirty-eight countries co- 
operating in the European Qualifications Framework 
(EQF). 1 As more of these frameworks become opera- 
tional, their role as agents of change is ever more ap- 
parent. While the character and strength of their im- 
pact differs between countries and across sectors, this 
chapter will show that NQFs are increasingly influenc- 
ing the character and workings of national education 
and training systems. 

Following a presentation of the main developments in 
Europe, this chapter reflects on the different ways in 
which NQFs are influencing education, training and em- 
ployment policies and practices in European countries. 
The concluding part discusses the implications of these 
developments for our overall understanding of the role 
and function of NQFs, exemplified by the distinction be- 
tween communication, reforming and transformational 
frameworks introduced by David Raffe (2009 b, 2011). 

NATIONAL QUALIFICATIONS FRAMEWORKS IN 
EUROPE: OVERALL PROGRESS 

At the beginning of 2015, thirty-eight European coun- 
tries had developed forty-two national qualifications 
frameworks. The following figures reflect the situation: 

• Thirty-four countries 2 are working towards compre- 
hensive NQFs covering all types and levels of qualifi- 
cations (compared with thirty in 2013). 

• Four countries have introduced partial NQFs covering 


1 These are the twenty-eight EU member states as well as 
Albania, Bosnia-Herzegovina, Iceland, the Former Yugoslav 
Republic of Macedonia (FYROM), Lichtenstein, Montenegro, 
Norway, Serbia, Switzerland and Turkey. 

2 In the United Kingdom (where education is devolved to the 


a limited range of qualification types and levels or con- 
sisting of separate frameworks operating apart from 
each other. This is exemplified by the Czech Republic 
and Switzerland, where separate frameworks for vo- 
cational and higher education (HE) qualifications have 
been developed; by France where only vocationally 
and professionally oriented qualifications are included 
in the framework; and by Italy, where frameworks are 
restricted to qualifications from HE. 

• Twenty-nine NQFs have been formally adopted (com- 
pared with twenty-four in 2013). 

• Eighteen countries have reached operational stage 
(compared with sixteen in 2013). In seven of these - 
Belgium (Flanders), Denmark, France, Ireland, Malta, 
the Netherlands and the United Kingdom - NQFs are 
fully operational (compared with five in 2013). 

• Thirty-two countries have proposed or adopted eight- 
level frameworks (twenty-eight in 2013). 

• Twenty-seven countries have presented referencing 
reports 3 showing how their national frameworks re- 
late to the EQF. 

• Twenty-four NQFs are self-certified against the Bologna 
framework, fifteen jointly with EQF referencing. 

• Nine countries indicate EQF levels on certificates, di- 
plomas or Europass documents (up from six in 2013). 

The EQF has been the main catalyst for the rapid devel- 
opments and implementation of NQFs in Europe. Almost 
all countries have recognized that NQFs are necessary in 
relating national qualifications levels to the EQF in a trans- 
parent and trustworthy manner. By February 2015, twen- 
ty-four countries had referenced their national qualifica- 
tions levels to the EQF: Austria, Belgium (FL, FR), Bulgaria, 
Croatia, the Czech Republic, Denmark, Estonia, France, 
Germany, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania, 
Luxembourg, Malta, Montenegro, the Netherlands, 


individual constituent countries), the frameworks for 
Scotland and Wales are comprehensive. The Qualifications 
and Credit Framework for England and Northern Ireland 
(QCF) includes only vocational/professional qualifications. 

3 Cyprus, Greece and Romania still need to complete this process. 
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Norway, Poland, Portugal, Slovenia and the United 
Kingdom. In addition, three countries, Cyprus, Greece and 
Romania, were in dialogue with the EQF advisory group on 
the finalization of their reports. The remaining countries are 
expected follow suit in the near future. It is worth noting 
that the number of countries in EQF cooperation increased 
during 2014 from thirty-six to thirty-eight, 4 highlighting 
the increasing relevance of the EQF. 

The development of NQFs in Europe also reflects the 
Bologna process and the agreement to implement 
qualifications frameworks in European higher educa- 
tion (QF-EHEA). Twenty-four countries have formally 
'self-certified' their HE qualifications to the QF-EHEA. 
Countries are increasingly combining referencing to the 
EQF with self-certification to the QF-EHEA. 5 Austria, 
Bulgaria, Croatia, Estonia, Hungary, Iceland, Latvia, 
Lithuania, Luxembourg, Malta, Montenegro, Norway, 
Poland, Portugal and Slovenia have all produced joint 
reports on both processes, reflecting the priority given 
to the development and adoption of comprehensive 
NQFs covering all levels and types of qualification. It 
is expected that this approach will be chosen by most 
countries preparing to reference to the EQF in 2015. 
This development reflects the increasingly close coop- 
eration between the two European framework initia- 
tives, which is also illustrated by regular meetings be- 
tween EQF national coordination points and Bologna 
framework coordinators. 

NQFs IN EUROPE: COMMON CHARACTERISTICS 
AND CHALLENGES 

The initial technical and conceptual design of NQFs has 
now been finalized in most countries. The following com- 
mon characteristics can be identified: 


4 The two new countries are Albania, and Bosnia and 
Herzegovina. 

5 Self-certification reports verify the compatibility of the national 
framework for higher education with the QF-EHEA. 

6 For example, for VET or HE. 


• NQFs have primarily been designed as comprehensive 
and to address all levels and types of qualifications (vo- 
cational education and training [VET], HE and general 
education) (in thirty-four of the thirty-eight countries, 
as noted above). The remaining countries - the Czech 
Republic, France, Italy and Switzerland - have devel- 
oped frameworks with a limited scope, or have chosen 
to develop and implement separate frameworks for VET 
and HE. Some countries, such as Germany and Austria, 
have agreed on comprehensive NQFs but are taking a 
step-by-step approach under which some qualifications 
(for example school, leaving certificates at upper sec- 
ondary level) have still to be included. 

• Comprehensive European NQFs can mostly be de- 
scribed as loose frameworks'. This enables them to 
embrace the full range of concepts, values and tra- 
ditions existing in the different parts of the educa- 
tion and training system covered by the framework. 
Whether a framework is tight or loose depends on 
the stringency of conditions a qualification must meet 
to be included (Tuck, 2007). Loose frameworks intro- 
duce a set of comprehensive level descriptors to be 
applied across sub-systems, but allow substantial spe- 
cialization within each sub-framework. 6 Tight frame- 
works are normally regulatory frameworks, and define 
uniform specifications for qualifications to be applied 
across sectors. In South Africa and New Zealand, at- 
tempts to create tight and ‘one-size-fits-all' variants 
generated a lot of resistance and undermined the 
overarching role of the framework. These experiences 
have led to a general reassessment of the role of these 
frameworks, pointing to the need to protect diversity 
(Allais, 2011c; Strathdee, 2011). In contrast to this, in 
most European countries, the inclusion of formal qual- 
ifications in NQFs is based on sector-based legislation, 
not on uniform rules covering the entire framework. 
This is illustrated by the proposed Polish framework, 
where generic, national descriptors are supplemented 
by more detailed ones for the sub-systems of gen- 
eral, vocational and higher education. While not so 
explicitly addressed by other frameworks, the basic 
principle applies across the continent. 

• NQFs are widely considered to be an important tool 
in supporting national lifelong learning strategies, 
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notably through their recognition of qualifications 
awarded in non-formal learning contexts, by promot- 
ing the validation of non-formal learning and by re- 
ducing barriers to progression in education, training 
and learning. The overarching perspective of com- 
prehensive frameworks is critical for achieving life- 
long learning objectives. 

The majority of countries have introduced eight-level 
frameworks. Three exceptions among the recently de- 
veloped frameworks are Norway and Iceland, both of 
which have seven levels, and Slovenia, which uses ten 
levels. The seven-level framework in Norway reflects 
the formal education and training structure, which 
no qualifications are offered below NQF/EQF level 
2. One of the reasons that Slovenia chose to adopt 
ten levels was to better accommodate legacy awards 
such as magister znanosti. The prevailing similarity of 
structure among the majority of countries demon- 
strates that achieving international comparability of 
the NQF structure is a priority. 

While all countries describe their NQFs as commu- 
nication tools designed to improve the transparency 
and comparability of national qualifications systems, 
many countries also see NQFs as contributing to incre- 
mental reform, notably as regards the shift to learn- 
ing outcomes and improved stakeholder cooperation 
and dialogue. This allows the existing education and 
training system and the framework based on learning 
outcomes to be gradually and progressively aligned 
with each other, and makes it possible to develop key 
stakeholders' understanding and sense of ownership 
of the key concepts of NQF. 

Although a broad range of stakeholders participate in the 
design and development of frameworks, NQFs predomi- 
nantly address the needs of the education and training 
sector, and to a lesser extent those of the labour market 
(Raffe, 2012a). They tend to be seen as only partly rel- 
evant to (for example) employees and employers. 

All countries have level descriptors based on learn- 
ing outcomes reflecting the EQF level descriptors 
(knowledge, skills and competence). Evidence shows, 
however, that many countries combine this with links 
to inputs, and emphasize that these two approaches 
are complementary rather than mutually exclusive. 
Cedefop's evidence (2015a) shows that the roles and 
functions of NQFs differ between countries and sec- 
tors. They range from (a limited number of) frame- 
works with a regulatory function to (a majority of) 
frameworks of a descriptive and classification charac- 
ter whose impact can only be an indirect one. 
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IMPACT OF NQFs 

National authorities have frequently stated (Cedefop, 
2010, 2012, 2013, 2015a) that national qualifications 
frameworks are designed and mandated to describe 
national qualification systems, not change them. Only 
a few countries have explicitly underlined the role of 
frameworks as an instrument for reform and change. This 
creates the impression that most NQFs will play only a 
limited role in the overall modernization of education and 
training systems. Cedefop's evidence - contrary to the 
above - shows that most NQFs now embrace elements 
of reform, going beyond a limited transparency and 
communication function. While the launch of NQFs may 
have been low-key in many countries, their introduction 
signals a shift in perspective, with a possible long-term 
impact on policies as well as practices: 

• The introduction of comprehensive NQFs, covering all 
levels and types of qualification, allows for a focus on 
relationships between institutions and sectors, and a 
stronger focus on lifelong and life-wide learning. This 
is in line with the objectives set for most NQFs, which 
aim at improving the links and bridges between levels 
and types of qualification. Eliminating dead-ends and 
promoting vertical and horizontal progression is con- 
sidered a key task for most of the new frameworks. 
For example, in some countries the overarching NQF 
enhanced and facilitated discussion between different 
stakeholders on access, admission and the recognition 
of qualifications at NQF levels equivalent to EQF level 
5. This has already been translated into policy decisions 
on the introduction of new qualifications in some coun- 
tries, for example initial VET qualifications at NQF level 
5 in Estonia. 

• The role of NQFs in promoting and systematically im- 
plementing a shift to learning outcomes allows for more 
learner-centred approaches influencing teaching, train- 
ing and assessment methods, as evidence from some 
case studies has shown (Cedefop, 2015b, 2015c). 

• Comprehensive NQFs can provide a platform for dia- 
logue and cooperation, for stakeholders within educa- 
tion and training as well as between the labour mar- 
ket and the education and training sector. As evidence 
shows, the development of overarching frameworks 
has triggered dialogue across sectors and has encour- 
aged cooperation between them in many European 
countries. The examples of Croatia, Estonia, Malta, 
Montenegro and Romania show that this cross-sectoral 
cooperation is increasingly being institutionalized. 
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None of these impacts will follow automatically from the 
introduction of a NQF. Without long-term implementation 
strategies, supporting policies and the strong commitment 
of all stakeholders, frameworks may end up as bureaucratic 
exercises without any practical impact. CEDEFOP's 2015 
analysis of European NQF identifies eight areas where a 
real impact can now be identified. 

CONDITIONS AND IMPACT AREAS 

a) Learning outcomes 

European NQFs are mainly connected through their em- 
phasis on learning outcomes. Recent research on the shift 
to learning outcomes (Cedefop's, 20156) shows that this 
principle has been broadly accepted among European 
policy-makers, and that NQFs have contributed to this 
shift. This research, building on similar work carried out 
in 2007 and 2008 (Cedefop, 2009), demonstrates that 
the introduction of NQFs is the most important factor 
influencing policies in this area. While the approach was 
previously taken forward in a fragmented way in sepa- 
rate institutions and sub-systems, evidence shows that 
the emergence of comprehensive frameworks has made 
it possible, to a certain degree, to approach the shift to 
learning outcomes in a more systematic and, to some ex- 
tent, more consistent way. In countries such as Belgium, 
Croatia, Greece, Iceland, Lithuania, Norway and Poland, 
we can observe that the introduction of frameworks has 
led to the identification of areas where learning out- 
comes have not previously been applied or where these 
have been used in an inconsistent way, even within one 
education sector. The Norwegian NQF reported a lack 
of descriptions and standards for advanced vocational 
training based on learning outcomes ( Fagskole ), resulting 
in work to remedy this weakness. 

b) The impact of NQFs - stakeholder involvement 

The new generation of European NQFs has helped to 
bring together stakeholders from different sub-sys- 
tems in education who did not commonly cooperate 
or speak to each other before, as well as stakeholders 
from education and employment. Evidence shows that 
a broad range of stakeholders from different sectors in 
education and the labour market have been involved 
in the development of frameworks. Most participants 
signal that they want to continue and if possible in- 
stitutionalize these processes. A key question now is 
whether this initial success can be turned into a per- 
manent feature of the frameworks. While the initial 
development stage has been limited in time and scope, 
long-term implementation will require a different and 


stronger commitment, especially by engaging stake- 
holders from the labour market. 

c) The impact of NQFs - institutional reform 

NQFs are contributing directly to institutional re- 
form in some countries. Ireland, Malta, Portugal and 
Romania exemplify this through their decisions to 
merge existing and multiple qualifications bodies into 
one body covering different types and levels of qualifi- 
cation. Some other countries also have plans to merge 
qualifications authorities or to establish new institu- 
tions (there is a proposal for a national qualifications 
council in Sweden). This shows that comprehensive 
NQFs can trigger institutional reform, even in cases 
where their main role is seen as promoting transpar- 
ency. It is no coincidence that Ireland, following more 
than a decade of framework development, has now 
opted for one coherent quality and qualifications au- 
thority. The merging of the four previously existing 
bodies seems to reflect the structure and principles 
of the comprehensive NQF, and will also aid further 
development and implementation of the framework 
and strengthen the quality assurance underpinning 
qualifications. 

d) The impact of NQFs - the bridging of institutions 
and sub-systems 

Several countries see the NQF as a tool for strengthen- 
ing the links between education and training sub-sys- 
tems. This is considered essential in improving permea- 
bility and reducing barriers to progression in education, 
training and learning. As previously stated, the new 
generation of European NQFs overwhelmingly consists 
of comprehensive frameworks, addressing all types and 
levels of qualification. This means that they and their 
descriptors have to reflect a huge diversity of purposes, 
institutions, traditions and cultures. One of the funda- 
mental challenges faced by comprehensive frameworks, 
Young and Allais state (2009, 2011), is to take into ac- 
count the epistemological differences in knowledge and 
learning in different parts of the education and training 
system. 

e) The impact of NQFs - developing and renewing 
qualifications 

The introduction of comprehensive NQFs adds value 
by creating an overview. The introduction of levels 
based on learning outcomes and the location of quali- 
fications according to these levels, makes it possible to 
identify gaps in the existing provision of qualifications. 
Cedefop's 2014 study shows that EQF level 5 (and 
the relevant NQF levels) has been used as a platform 
for the development of new qualifications. This is 
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exemplified by the Czech Republic, Estonia, Latvia, 
Lithuania, Malta and the United Kingdom. The new 
qualifications might, in some cases, be initial voca- 
tional qualifications, as is the case in Estonia. In other 
cases, as is currently being discussed in the Czech 
Republic, they might be HE qualifications. Lithuania 
is typical of countries in which there are currently no 
qualifications linked to this level (although there had 
been qualifications of this level awarded in vocational 
colleges until 2004). The demand for qualifications at 
this level has now been documented, and both the 
VET and the higher education sectors are consider- 
ing responses. Initial VET schools are seeking to revise 
some of their courses and to upgrade them to level 5. 
Colleges of higher vocational education, meanwhile, 
seek to introduce programmes with a short study cy- 
cle and to link these qualifications to level 5. 

f) The impact of NQFs - opening up to the private and 
non-formai sector 

The majority of the new NQFs have limited their cov- 
erage to formal qualifications awarded by national au- 
thorities or independent bodies accredited by these au- 
thorities. This means that frameworks predominantly 
cover initial qualifications offered by public education 
and training institutions. While there are exceptions to 
this general picture, most NQFs do not cover qualifica- 
tions resulting from training and learning taking place 
in the non-formal and private sector. This is problem- 
atic as important qualifications linked to continuing 
and further education and training are left out of the 
picture. Since 2011/12, attention has increasingly been 
paid to this potential weakness in the scope of frame- 
works. Some countries, including Austria, Germany, 
the Netherlands, Norway and Sweden, have started 
working on procedures for including non-formal and 
private-sector qualifications and certificates. 

g) The impact of NQFs - recognition of qualifications 
The effect of qualifications frameworks on the mobil- 
ity of learners and workers is still uncertain (European 
Commission and GHK, 2013). This reflects the fact 
that full implementation has yet to be achieved and 
that the referencing to the EQF has yet to be finalized. 
However, evidence gathered by a study of the poten- 
tial role of qualifications frameworks in supporting 
the mobility of workers and learners (DEEWR and DG 
EAC, 2011) shows that there are great expectations 
that qualifications frameworks will support mobil- 
ity though better recognition of qualifications. NQFs 
provide an important link to detailed information on 
qualifications; notably on learning outcomes but also 
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on workload and the type of qualification. These are 
all essential elements required for recognition of qual- 
ifications. The potential role to be played by qualifica- 
tions frameworks in this context is expressed in the 
new (2013) subsidiary text to the Lisbon recognition 
convention. This text underlines that frameworks 
should be used systematically as a source of informa- 
tion supporting decisions on recognition. 

h) The impact of NQFs - validation of non-formal and 
informal learning 

The 2012 recommendation on the validation of non- 
formal and informal learning sees the link to NQFs as 
important for the further implementation of validation 
arrangements across Europe. Overall, NQFs and vali- 
dation are bound together through their shared em- 
phasis on learning outcomes. The 2012 recommenda- 
tion states that for validation 'the same or equivalent 
(learning outcomes based) standards to those used in 
formal education' should be used. NQFs thus provide 
a common reference point for learning acquired inside 
as well as outside formal education and training. The 
2014 update of the European Inventory on Validation 
of Non-Formal and Informal Learning (European 
Commission, Cedefop and ICF International, 2014) 
confirms the priority given to the linking of frame- 
works and validation arrangements. 

NQFs AS AGENTS OF CHANGE - THE NEED FOR A 
MORE NUANCED UNDERSTANDING 

As indicated above, the majority of European NQFs were 
originally seen as tools for increasing the transparency of 
qualifications and for better describing and promoting the 
existing system. This modest ambition contrasts with the 
approach chosen by some of the earlier NQFs. Several of 
them took on extensive regulatory and reform functions. 
With reference to Raffe (2009 b), NQFs can be placed on 
a continuum stretching from communication to transfor- 
mational frameworks ( Table 1.1). 

During the last few years, as implementation of frame- 
works has progressed, some NQFs have taken on 
a reforming role somewhere in between these two 


7 See the subsidiary text to the Lisbon recognition conference 
‘Recommendation on the use of qualifications frameworks in 
the recognition of foreign qualifications': www.cicic.ca/docs/ 
lisboa/Recommendation_on_the_use_of_qualifications_ 
frameworks_in_the_recognition_of_foreign_qualifications.pdf 


GLOBAL INVENTORY OF NATIONAL AND 
REGIONAL QUALIFICATIONS FRAMEWORKS 


13 


extremes. NQFs starting with a limited communica- 
tion mandate can, in several cases, be seen to extend 
and deepen their roles and functions, beginning to act 
as agents for change in particular political and insti- 
tutional contexts. At the other end of the continuum 
we can see that the English QCF is about to lose some 
of its regulatory functions, placing it closer to other 
European NQFs. These adjustments show that quali- 
fication frameworks are dynamic tools, and their func- 
tions and objectives may shift as they develop in line 
with short-term as well as long-term policy agendas. 
What is clear, however, is that it is far too simplistic to 
categorize European NQFs as either communication or 
transformation frameworks. To be able to understand 
the impact of NQFs we need to distinguish between 
the different policy areas and (education) sectors in 
which they work. 

In some areas, for example concerning the shift to 
learning outcomes, some frameworks have already be- 
come important agents of change and have taken on 
a reforming role. In other areas, for example the for- 
mal recognition of qualifications, frameworks take on 
a more limited communication role and are only to a 
limited extent involved in reform. These different roles 
are illustrated in Table 1.2 and Table 1.3. 

These two tables demonstrate that it makes little sense to 
categorize NQFs as either communication or transforma- 
tion (or reform) frameworks. What becomes clear is that 
frameworks can combine communication and transfor- 
mation functions and roles in different ways, reflecting the 
particular national situation and context. This flexibility, 
which grows more apparent as frameworks mature and 
become operational, opens up the opportunity for more 
targeted strategies in which NQFs are used as reform 


tools in particular areas and as communication tools in 
other areas and sectors. This targeted strategy, however, 
requires frameworks to be firmly embedded in the na- 
tional political and institutional setting. In cases where 
frameworks are taken forward as isolated initiatives, out- 
side the regulatory systems and their day-to-day running, 
their ability to make a difference is seriously reduced. 

CONCLUSION 

Cedefop's evidence, based on its monitoring of European 
NQF developments since 2009, shows that the major- 
ity of comprehensive NQFs can be described as ‘loose’ 
frameworks with limited regulatory functions. While it 
seems clear that this looseness provides flexibility and al- 
lows frameworks to embrace a broad range of qualifica- 
tions and institutions, and to make an impact in some ar- 
eas, it is questionable whether comprehensive NQFs will 
receive regulatory functions in particular areas. Currently, 
most comprehensive frameworks are comprised of sub- 
frameworks that are regulated by sectoral laws and by- 
laws. The alignment of legal sectoral frameworks with 
emerging comprehensive NQFs will be crucial in ensuring 
they are better able to operate as integrated and per- 
manent features of the national education, training and 
employment systems. Most frameworks have now been 
formally adopted, and developments in the coming years 
will demonstrate the extent to which they will become 
truly integrated into education, training and employment 
policies. 


Authors: 

Jens Bjornavold and Slava Pevec Grm, Cedefop 


Table 1.1: The functions of NQFs 


COMMUNICATION 


TRANSFORMATION 

Starts from existing education and training system 


Starts from a vision of the future ET system 

Incremental change 


Reform and transformation 

Tool for change A 

S r 1 ' 

v Driver of change 

‘Bottom-up' 1 

r ' 

* 'Top-down' 

Voluntary 


Statutory/regulatory 

Providers have central role 


Providers included among stakeholders 

Loose 


Tight 


Source: adapted from Raffe (2009b). 
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Table 1.2: The reform (transformative) role of NQFs in relation to the shift to learning outcomes 


NQFs AND THE REFORMING/TRANSFORMATION OF LEARNING OUTCOMES 


STARTS FROM THE FUTURE EDUCATION 
AND TRAINING SYSTEM 

In many European countries the NQF has been a driver in in- 
troducing learning outcomes, setting a target for the future. 

REFORM AND TRANSFORMATION 

The shift to learning outcomes can, over the long term, have 
deep implications for the way qualifications are defined and 
described, the way assessment takes place and the way 
labour-market stakeholders are involved in the review and 
renewal of education and training. 

DRIVER OF CHANGE 

Research (Cedefop, 2009, 2015b) demonstrates that NQFs 
have been a major driver in introducing learning outcomes 
on a more systematic basis across Europe. 

REGULATORY 

In a number of countries the learning outcomes approach, as 
a part of the NQF approach, is now legally established and 
represents a requirement for providers. 

PROVIDERS INCLUDED AMONG 
STAKEHOLDERS 

A key factor in implementing learning outcomes is broad 
participation allowing for dialogue between different 
stakeholders. 

TIGHT 

This need not be the case as the implementation of learning 
outcomes requires flexibility and, to some extent, decentral- 
ized decisions and interpretations. 


Source:Jens Bjornavold and Slava Pevec Grm, Cedefop 
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Table 1.3: The communication role and processes of NQFs in relation to formal recognition of qualifications 


THE COMMUNICATION ROLE OF NQFs IN RELATION TO FORMAL 
RECOGNITION OF EDUCATIONAL QUALIFICATIONS 


STARTS FROM PRESENT ET SYSTEM 

NQFs can support the existing arrangements for recognition 
at international, national and institutional level by providing 
transparency and improved documentation on qualifications. 

INCREMENTAL CHANGE 

NQFs can facilitate recognition on a longer-term basis by 
strengthening mutual trust and, thus, removing obstacles to 
recognition. This can only happen on an incremental basis 
and over time. 

TOOL FOR CHANGE 

NQFs stand out as one tool among several supporting and 
facilitating recognition. 

'BOTTOM-UP' 

As important decisions on recognition will be taken at the 
level of local institutions, the impact of NQFs depends on 
their ability to strengthen transparency among end-users. 

VOLUNTARY 

As tools for communication, NQFs need to be trusted as high- 
quality information sources and to play a role. 

PROVIDERS HAVE CENTRAL ROLE 

Providers play a key role in recognizing the need for further 
learning and will, therefore, play a key role in the application 
of NQFs for this purpose. 

LOOSE 

The loose character of the frameworks makes it possible to 
give priority to transparency issues across sectors. 


Source:Jens Bjornavold and Slava Pevec Grm, Cedefop 
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CHAPTER 2' 

LINKS BETWEEN NQFs AND VALIDATION OF NON-FORMAL 
AND INFORMAL LEARNING 


INTRODUCTION 

The validation of non-formal and informal learning is gain- 
ing importance across the globe. The economic crisis has 
caused a wave of displacement (dislocation) of workers 
who need to redirect their educational and work careers. 
The skills they have acquired in a specific sector might not 
be visible or acknowledged in other sectors where they 
might, nevertheless, be useful. The knowledge and skills 
of individuals therefore needs to be identified, recognized 
and utilized in a more efficient manner. This recognition 
of skills can be better achieved through the use of nation- 
al qualifications frameworks based on learning outcomes. 
Their emphasis on achievements rather than pathways 
is important in opening up qualifications to non-formal 
and informal learning, and in providing comparability be- 
tween programmes of non-formal and formal learning. 
A systematic approach to outcomes, promoted through 
NQFs in ways that influence standards, curricula and as- 
sessment, as well as teaching and learning forms, fits well 
into the ambition of validation. 

‘In their most basic sense NQFs can be understood as 
classifiers specifying the relationship - horizontally and 
vertically - between different qualifications' (Bjornavold 
and Coles, 2010). The qualification framework acts as a 
beacon that allows individuals to understand their com- 
petences within a system of qualifications. By linking vali- 
dation to NQFs, it is possible to place competences and 
knowledge acquired outside the formal system into an 
agreed (formalized) reference framework that can be un- 
derstood by different sectors of the economy and society 
at large. NQFs are becoming important tools for educa- 
tional reforms across the globe (Cedefop, 2013a, 2013b, 
2014; Singh and Duvekot, 2013; UIL, 2014, 2015) and, 
in many cases, these reforms include arrangements for 
validation. 

While the link between NQFs and validation is gaining 
momentum, it is necessary to understand in what way 
these links are actually being developed and to identify 
the main challenges to the successful implementation of 
those links. The present chapter brings together exper- 
tise from UIL and Cedefop in order to explore the links 


between validation and NQFs from a global perspective. 
Both organizations are well recognized in the area of vali- 
dation of non-formal and informal learning. The chap- 
ter draws on the latest evidence collected through the 
UlL's e-platform, the Global Observatory of Recognition, 
Validation and Accreditation (RVA) (UIL, 2014), and the 
2014 update of the European Inventory on validation of 
non-formal and informal learning (European Commission, 
Cedefop and ICFI, 2014a, 20146). Both constitute unique 
and rich sources of information on validation across the 
globe. 

WHAT IS VALIDATION? 

In Europe, the EU's 2012 recommendation on the vali- 
dation of non-formal and informal learning defines val- 
idation as ‘a process of confirmation by an authorised 
body that an individual has acquired learning outcomes 
measured against a relevant standard'. According to UIL, 
‘validation is the confirmation by an officially approved 
body that learning outcomes or competences acquired 
by an individual have been assessed against reference 
points or standards through pre-defined assessment 
methodologies' (UIL, 2012). The 2012 recommenda- 
tion makes it clear that validation includes four distinct 
phases: identification, documentation, assessment and 
certification (European Union, 2012). UIL approach- 
es validation alongside recognition and accreditation. 
Recognition refers to ‘a process of granting official status 
to learning outcomes and/or competences' (UIL, 2012). 
UNESCO, like the European Union, sees accreditation in 
terms of ‘evaluation of the quality of an institution or 
a programme by an officially approved body'. However, 
UNESCO also emphasizes the fact that accreditation of 
a programme implies the award of qualifications, credit 
units or exemptions (ibid.). Accreditation normally applies 
to an institution or programme. The terms 'recognition' 
and 'validation' are used in relation to individual learners. 

Validation of non-formal and informal learning cuts 
across several policy areas and disciplines. This means 
that the concept is used in different ways and that sev- 
eral terms are used similarly. Thus, while in the European 
Commission the phrase ‘validation of non-formal and 
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informal learning' (VNFIL) is used, UNESCO talks about 
the ‘recognition, validation and accreditation (RVA) of 
the outcomes of non-formal and informal learning'. Each 
of these phrases emphasizes specific aspects of the vali- 
dation process, although all approaches have in common 
a process of some sort whereby an authorized body veri- 
fies that certain learning outcomes have been acquired. 
These differences in definition are more of form than 
substance, since the four stages of validation referred to 
in the 2012 recommendation include most aspects cov- 
ered in the UNESCO definition. Cedefop, like UNESCO, 
approaches validation in an integrated way, connecting it 
to the labour market as well as using it in relation to for- 
mal education. In addition, both organizations have high- 
lighted the multi-dimensional purposes of validation: as a 
means of accessing formal qualifications and entering the 
formal education and training system, and as a means 
to make existing competences and learning visible. Both 
perspectives imply an integrated approach with the po- 
tential to draw together the various sectors (education, 
work and society) and purposes of personal, social and 
economic development, as well as separate, but linked, 
processes of formative and summative assessment. 

This chapter focuses specifically on the concept of valida- 
tion as a process that permits the confirmation by an au- 
thoritative body of learning outcomes acquired in a non- 
formal or informal learning process. It might be helpful to 
describe briefly the definitions of formal, non-formal and 
informal learning. According to the UNESCO guidelines 
on RVA (UIL, 2012): 

• Formal learning takes place in education and training in- 
stitutions, is recognized by relevant national authorities, 
and leads to diplomas and qualifications. Formal learn- 
ing is structured according to educational arrangements 
such as curricula, qualifications and teaching-learning 
requirements. 

• Non-formal learning is learning that has been ac- 
quired in addition or alternatively to formal learning. 
In some cases, it is also structured according to educa- 
tional and training arrangements, but it is more flex- 
ible. It usually takes place in community-based set- 
tings, the workplace and through the activities of civil 


society organizations. Through the recognition, vali- 
dation and accreditation process, non-formal learn- 
ing can also lead to qualifications and other forms of 
recognition. 

• Informal learning is learning that occurs in daily life, 
in the family, in the workplace, in communities and 
through the interests and activities of individuals. 
Through the recognition, validation and accreditation 
process, competences gained in informal learning can 
be made visible, and can contribute to qualifications 
and other forms of recognition. In some cases, the 
term ‘experiential learning' is used to refer to informal 
learning that focuses on learning from experience. 

The Council of the European Union, too defines formal, 
non-formal and informal in a similar way (Council of the 
European Union, 2004). 

THE LINKS 

BETWEEN VALIDATION 
AND QUALIFICATIONS 
FRAMEWORKS 

VALIDATION IN THE WIDER CONTEXT OF 
LIFELONG LEARNING 

Initiatives on the validation of non-formal and informal 
learning are normally integrated into lifelong learning 
polices. Singh and Duvekot (2013) examine the lifelong 
learning approach at macro and micro levels. At the mac- 
ro level the lifelong learning approach calls for a more 
flexible and integrated system, as can be seen through 
the development of NQFs that respond to the growing 
need to recognize learning and knowledge that has been 
achieved outside the formal education sectors (see also 
Villalba, 2009). At the micro level recognition practices 
serve as bottom-up strategies that support individuals by 
providing the basis for goal-directed development and 
career planning involving tailor-made learning and on- 
going documentation of their professional and personal 
development (see e.g. Rubenson, 2001). 
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The lifelong learning approach is not just about raising levels 
of qualification in society. It is also about widening the par- 
ticipation of those people previously excluded from learning 
opportunities (Singh and Duvekot, 2013). To this end, valida- 
tion practices are seen as key to achieving reintegration into 
learning. In low-income and emerging economies, lifelong 
learning is strongly connected to non-formal education rath- 
er than to formal education. Lifelong learning policies are in 
place to assist workers and minority groups working for low 
wages in small enterprises. In these contexts, RVA has great 
untapped potential. Already, recognition of non-formal and 
informal learning is regarded as a particularly important ele- 
ment of NQFs in several low-income and emerging econo- 
mies, as a means of redressing past inequalities in the provi- 
sion of access to formal education, training and employment 
opportunities (Singh, forthcoming). 

In Jordan, Afghanistan, Syria and Namibia, alternative 
ways of meeting the learning needs of people of differ- 
ent ages and backgrounds are made possible through 
the establishment of equivalencies, recognition of prior 
learning and skills-gap training (Singh, forthcoming). In 
Europe, most validation policy strategies are also framed 
within lifelong learning policies, although in several coun- 
tries validation of non-formal and informal learning took 
place prior to the inclusion of lifelong learning policies. 
In Europe, too, validation practices are in many cases 
targeted at individuals at risk of exclusion, or people al- 
ready excluded from education. In Portugal, for exam- 
ple, the New Opportunities Governmental Action Plan 
2005-2010 was targeted at individuals with few or no 
qualifications. According to CNE (2011: 138), the number 
of adults enrolled at Centros de Novas Oportunidades 
(New Opportunities Centres) between 2000 and 2010 
was around 1,316,955, some 19 per cent of the work- 
force. These individuals were aiming to get a basic or a 
secondary certificate of education through validation of 
their non-formal and informal learning (Oliveira, 2014). 

However, validation is not only about assessing and grant- 
ing qualifications to people without any previous quali- 
fications or with only low-level qualifications. In France 
there is particular interest in obtaining post-secondary 
qualifications for career purposes. Competency-based 
training and occupational standards schemes, such as the 
Estonian Professional Qualifications Scheme will and the 
Turkish national vocational qualifications system, have 
been introduced to provide a way of demonstrating that 
people meet labour market requirements, when there is 
lack of confidence in the value of existing qualifications. 
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Singh and Duvekot (2013), in reviewing several strategies, 
indicate that legislative reforms and recognition policies 
raise the profile of the validation of non-formal and infor- 
mal learning, attract attention from private stakeholders 
and facilitate linkages between qualification frameworks 
more generally. The 2014 validation inventory shows an 
increase from 2010 in the number of countries that have 
established a validation strategy (European Commission, 
Cedefop and ICFI, 2014b). This might be partly a result 
of the 2012 recommendation on the validation of non- 
formal and informal learning which called on EU member 
states to put in place validation arrangements by 2018 
(Cedefop, 2014; Villalba et a!., 2014). Cedefop (2015) 
also shows that for several countries the political proc- 
ess of developing validation arrangements is integrated 
into the process of developing NQFs, and, further, into 
the process of referencing to the EQF. In some cases, the 
NQF is seen as an opportunity to coordinate existing and, 
to some extent, fragmented arrangements, as in Austria 
or Italy, while in other countries it is an opportunity to 
start practically from scratch, as in Greece or Croatia. 

However, countries, having NQFs that cover qualifications 
whose standards, curricula and assessment criteria are de- 
fined in terms of learning outcomes is a prerequisite for es- 
tablishing procedures for validation. An NQF without this 
deeper impact will face problems in facilitating validation of 
non-formal and informal learning. The next section looks 
into how explicit standards based on learning outcomes ac- 
commodate non-formal and informal learning. 

THE DEVELOPMENT OF STANDARDS 

NQFs can thus provide the common reference standard 
for competences acquired in formal, non-formal and in- 
formal settings. If validation is truly to become an alter- 
native route to qualifications, the qualifications acquired 
through validation and those acquired by attending for- 
mal education should be based on the same or equiva- 
lent standards. If they do not depend on equal standards, 
this will undermine validation practices and create the 
problem of type A and type B certificates with a different 
'currency' associated with them. 

In order for validation to be based on equivalent stand- 
ards, it is necessary that qualifications are described 
in terms of learning outcomes. These means that it is 
what the individual knows and is able to do at the end 
of the learning process that counts. However, in many 
instances, qualifications are based on a combination of 
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outcome-based standards (such as learning outcomes) 
and input-based standards (such as hours of train- 
ing). This poses difficulties in establishing validation ar- 
rangements that will apply in these different contexts. 
Outcome-based qualifications that are structured in units 
or modules and credit schemes can, moreover, facilitate 
the partial recognition of individuals who are not fully 
qualified, and support further training. 

Singh and Duvekot (2013) have differentiated five cat- 
egories of approaches used to establish the reference 
standards for validation. They categorize countries ac- 
cording to their main approach to standards, although, 
in reality, within the same country, different approaches 
might be used depending on the sector in question. They 
maintain that recognition of learning outcomes and com- 
petences can be based on: 

• standards defined in the comprehensive NQFs 

• education and training curricula that can be directly 
linked to a nationally established qualification, not or- 
ganized into a framework 

• competence frameworks specific to work (occupa- 
tional standards) 

• NQFs specific to the technical and vocational educa- 
tion and training (TVET) sector 

• standards for non-formal basic education for adults 
and young people. 

Given the diverse contexts in different countries, this catego- 
rization is a mix of NQF types (comprehensive or TVET) and 
standard types (education and training standards, occupa- 
tional standards or curricula). It does not pretend to create 
discrete categories; rather, it identifies elements which inter- 
act within an overall qualifications system. A comprehensive 
framework can contain both occupational and educational 
standards, and a framework can also link validation practices 
to curricula, as can be seen in several countries. 

A majority of the countries in Europe, the 2014 inventory 
shows, relate validation practices to NQFs. There were 
twenty countries, compared with twelve in 2010, that had 
explicit links between validation arrangements and the 
acquisition of formal qualifications covered in their NQFs. 
In the remaining EU countries, the link between NQF and 
validation is being discussed. In France, recognition and 
validation of non-formal and informal learning outcomes 
is directly linked to formal qualifications, as validation of 
acquired experience (VAE) specifically aims at the award 
of an official formal qualification (certification). The 


National Qualifications Directory, or RNCP, which was 
established by law in 2002 and integrates the national 
repository of skills descriptions (ROME), is the basis for 
the French NQF (Duchemin, 2014). However, in some 
countries the NQFs do not cover all educational levels 
but only some specific qualifications, such as in the Czech 
Republic where the NQF is focused on TVET. 

The Academic Credit Bank System in the Republic of 
Korea is an example of the second category: it identifies 
individual learning outcomes and competences based on 
education and training curricula that can be directly linked 
to a nationally established qualification. This 'bank' allows 
a citizen to receive accreditation for all learning outcomes, 
whether based on formal, non-formal or informal learning 
experiences. However, the Republic of Korea is develop- 
ing a Korean skills framework in order to make the ac- 
creditation easier. In a similar way, several EU countries 
in the process of developing NQFs, such as Sweden, are 
considering possibilities for validation directly linked to 
existing formal qualifications. 

There are also several countries in which the reference 
standards relate to competence frameworks specific to 
work (occupational standards). In Mexico, for example, 
the National Council for Standardization and Certification 
of Labour Competences (CONOCER) has developed 
and is responsible for a National System of Competence 
Standards (NSCS). CONOCER labour competence certifi- 
cates are equivalent to full or partial formal programmes, 
at technical and/or professional levels of the national 
education system. Similarly, in Malta, the current devel- 
opment of a Sector Skills Committee and Sector Skills 
Units will be a significant step in relation to establishing 
validation processes in relation to occupational standards 
(Sanderson, 2014). 

For the fourth category, Namibia, Burkina Faso, Ghana, 
India, and Trinidad and Tobago have either developed or 
are in the process of developing an NQF in the TVET sec- 
tor. Given that the harmonization of education and train- 
ing qualifications has still not been achieved and many of 
these countries, particularly in Africa, have yet to tran- 
scend the colonial legacy in their educational systems, 
adopting a pragmatic stance with respect to the focus 
on skills development and NQFs can be a useful strategy. 
Furthermore, as Allais (2010) points out, national voca- 
tional qualification frameworks (NVQFs) are less conten- 
tious, given their focus on outcomes and competence- 
based training, than are frameworks that try to embody 
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the disciplinary and content-driven approaches of gen- 
eral and university education programmes. National vo- 
cational qualifications are not associated with a particu- 
lar provider, facilitating wider recognition than thousands 
of provider-based qualifications in general and higher 
education. 

Several low-income countries and emerging economies 
report that the absence of an NQF is a limiting factor in 
developing competence frameworks for measuring learn- 
er progression. They are persuading education providers 
to recognize learning outcomes in the context of non-for- 
mal education while developing equivalency frameworks 
aligned to the formal education system, to assess non- 
formal education at the basic level (Singh and Duvekot, 
2013). Afghanistan, Bhutan, Syria and Jordan are some 
examples of this. 

The great advantage of NQFs is that they provide a refer- 
ence point for non-formally and informally acquired com- 
petences that otherwise would remain difficult to anchor in 
an existing, recognized information system. However, this 
can be achieved not by NQFs as such but by the extent to 
which NQFs contain and act as a beacon for standards, 
curricula and assessment based on learning outcomes, as 
well as teaching and training forms. If the learning out- 
comes are only found at the level of the NQF, its impact on 
validation might be limited. It is also important that stake- 
holders understand and buy into the issue of validation. 
The next section explores stakeholder involvement in the 
validation of non-formal and informal learning. 

STAKEHOLDER INVOLVEMENT 

The 2012 EU eecommendation asks member states to 
ensure that all relevant stakeholders are involved in the 
development of validation arrangements and that coor- 
dination among them is promoted. The UNESCO guide- 
lines also call for ‘ensuring all stake-holders have clearly 
defined roles and responsibilities' (UIL, 2012). UIL high- 
lights four models of implementation and coordination 
of the links between validation and NQFs: (1) systems of 
shared responsibility; (2) NQFs coordinating validation; 
(3) shared systems dominated by industry-based proc- 
esses; and (4) systems driven by stakeholders from the 
adult learning sector. These models are not exclusive of 
each other. 

In the first model, which is typical for Europe, the ten- 
dency is to divide recognition procedures between 
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levels of state authority, private stakeholders, commu- 
nity organizations and agencies of civil society in ac- 
cordance with laws, regulations and guidelines. In the 
second model, NQFs directly and explicitly coordinate 
recognition and validation. Australia, New Zealand, 
Namibia, South Africa and Mauritius have all subsumed 
RVA within legislation concerning the NQF and the rel- 
evant regulatory bodies. In Finland, arriving at a broad 
consensus on RVA at the level of policy development 
has been critical, particularly with respect to the incor- 
poration of RVA into the NQF. Several working groups 
for different qualification levels have promoted this ap- 
proach. In New Zealand, the standards for qualifica- 
tions in relevant schools and in tertiary education dom- 
inate the discourse on recognition and validation. (See 
also Singh, forthcoming.) 

In the third model, it is industry that is the driving force 
in a shared system. Although promoted and regulated 
by government, the National System of Competency 
Standards (NSCS) in Mexico is driven by employers and 
workers. In Australia, validation is offered by registered 
training organizations (RTOs) and state training au- 
thorities in accordance with the standards set out in the 
Australian Quality Training Framework. The RTOs are 
also responsible for assessments that lead to qualifications 
(DEEWR, 2008). Validation processes for workers are tai- 
lored to their needs and to the needs of the enterprises, 
and while partnerships with educational institutions are 
not excluded from these validation processes, they are not 
central to them. Nevertheless, the Australian government 
takes the lead role in ensuring that the system of recogni- 
tion functions reliably and transparently. 

In the fourth model, community adult educators and 
umbrella organizations, including adult education asso- 
ciations, are involved in validation and, more recently, in 
finding an anchor in the NQF. 

The 2014 inventory shows that in most European coun- 
tries the responsibility for validation is shared across min- 
istries, or national authorities, making validation in most 
instances a transversal concern. The issue of validation, 
however, remains driven by public organizations in charge 
of formal education, mainly related to VET. Public employ- 
ment services and adult education are also important driv- 
ers of validation arrangements in some European countries. 
Coordination with the private sector and with non-govern- 
mental organizations (NGOs) or civil organizations is still 
limited in the majority of countries. This does not mean 
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that private and civil-sector organizations are not involved 
in the development of validation practices. In several coun- 
tries, employers and trade unions play an important role 
in terms of policy and practice. In Spain, the private sector 
(including trade unions and business organizations) takes 
part in the development of legislation through represen- 
tation in the General Council for VET, the body that acts 
as an advisor for the development of legislation. Private- 
sector bodies are also responsible for providing guidance to 
individuals regarding the validation calls and the process. In 
addition, although in Spain validation is mainly led by pub- 
lic administration, trade unions and business organizations 
can request official announcements (calls for application) 
for validation for particular sectoral needs. 

The establishment of NQFs can serve as a catalyst for the 
determination of the roles and responsibilities of different 
stakeholders. It can also constitute a forum for discussion 
by different stakeholders of concerns related to the different 
nature of the learning acquired in non-formal and informal 
settings. Mexico has identified joint effort and consensus 
among employers, workers, educators and government of- 
ficials as the single most important factor for the success of 
RVA in workforce development. New Zealand highlights 
how industry training bodies, registered training organiza- 
tions and government can work together with learning in- 
stitutions to promote RVA constructively. Other good ex- 
amples of shared responsibility between stakeholders come 
from the Netherlands, where a quality code for applying 
RVA to an NQF is governed by the Ministry of Education 
and its social partners (Singh and Duvekot, 2013). 

QUALITY ASSURANCE 

In addition to providing a reference point and a forum for 
the engagement of relevant stakeholders, NQFs can con- 
stitute an extra source of quality assurance for validation 
processes. The inclusion of non-formally acquired quali- 
fications into the NQF requires that these qualifications 
follow the same or similar processes to ensure quality. 
Several countries in Europe have made it mandatory that 
there be an explanation of how any qualification that is 
included in the NQF can be acquired through non-formal 
or informal means. In Europe, this has meant that vali- 
dation systems normally lack a specific quality assurance 
mechanism, but rely on the existing quality assurance of 
the formal system. There is often an element of trust in 
existing qualifications in Europe, developed through col- 
lective agreements between stakeholders from the world 
of work and the world of education. 


In other parts of the world, however, this might not be the 
case. In the United States of America, there is a proposal 
to create a national competence-based framework for post- 
secondary education that will include certificate-level work- 
force education and training. The purpose is to ensure that 
credits acquired by currently non-credit-bearing workforce 
education and training, achieved in part or full through RVA, 
are of the same quality and have the same standing as quali- 
fications achieved as a consequence of formal education and 
training (Ganzglass et al., 2011). In other countries, the issu- 
ance of guidelines serves as a quality-assurance mechanism. 
In South Africa, the South African Qualifications Authority 
(SAQA) has issued guidelines for the implementation of rec- 
ognition and validation. The assessment of quality within the 
NQF relates to reliability, validity, authenticity, sufficiency 
and currency (SAQA, 2012). 

In many low- and middle-income countries, governments 
plan to promote quality assurance by creating synergies 
between formal and non-formal education. Philippines in- 
corporates its non-formal basic education programme into 
the Philippines Qualifications Framework by creating syn- 
ergies between formal and non-formal education. One of 
the aims of the Thai NQF is to serve as a reference for the 
learner/worker in the workplace or other learning settings. 
Individuals obtaining certificates through these programmes 
will have the same rights and qualifications as those who 
obtain certification in the formal schooling system. Under 
the Mauritian Qualifications Authority (MQA) Act 2001, 
training providers have to seek accreditation for their pro- 
grammes prior to delivery. Accreditation of programmes en- 
ables the MQA to set benchmarks for quality management 
arrangements in education and training for the TVET sector 
(see Singh, forthcoming). 

In short, there appear to be two ways of providing quality 
assurance in this context. In the first case, non-formal quali- 
fications are brought into the framework and they are sub- 
mitted to a common quality assurance regime. In the second 
case, quality-assurance focuses on improving quality-assur- 
ance procedures themselves, namely through processes of 
accreditation of non-formal programmes. 

CONCLUSIONS 

The process of developing validation and recognition 
arrangements can be closely interlinked with the proc- 
ess of developing NQFs. The NQF can provide the 
necessary reference point to make visible non-formal 
and informally acquired competences. However, this 
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requires that qualifications are expressed in terms of 
learning outcomes which act as a beacon for learning 
outcomes-based standards, curricula and assessment 
criteria, as well as teaching and learning forms; and that 
the requirements for obtaining them are not attached 
to a particular set of input-based standards (such as the 
duration or place of delivery of a course). In addition, 
in order for it to be feasible for qualifications to be ac- 
quired through non-formal and informal learning, the 
assessment systems need to remain flexible in order to 
accept less traditional students. 

The NQF process also provides an excellent opportunity 
for creating a forum for discussion of how to integrate and 
understand the role of knowledge and skills acquired out- 
side the formal system. Validation seems to remain an is- 
sue attached to public educational authorities in Europe. In 


GLOBAL INVENTORY OF NATIONAL AND 
REGIONAL QUALIFICATIONS FRAMEWORKS 


low- and middle-income countries, validation is related to 
the TVET sub-framework, particularly because of the focus 
on competency-based training and occupational standards. 
Providing skills to meet the needs of the labour market and 
developing a productive economy are important issues in 
these countries. This tendency also seems to be increas- 
ing in Europe, where public employment services, NGOs 
and employers are becoming more and more interested in 
the issue. Coordination among stakeholders, and especial- 
ly among different sectors, still remains limited, however. 
Much more effort needs to be made to create coherent, 
integrated validation systems and avoid fragmentation. In 
this process the NQF can provide a stepping stone. 
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CHAPTER 3' 

NQF LINKS WITH INFORMAL SECTOR SKILLS DEVELOPMENT 


INTRODUCTION 

The informal-sector employs the bulk of the world's 
working population. Workers in the informal economy 
are normally outside the protection of the state and 
have virtually no job security. It is estimated that around 
500 million people in the world work in the informal- 
sector (Ishengoma and Kappel, 2007). Self-employment 
accounts for 70 per cent of informal-sector jobs in sub- 
Saharan Africa, and 60 per cent in countries in other re- 
gions. According to the OECD report (2009), during the 
1990s informal-sector employment in total accounted 
for 57 per cent of all non-agricultural employment in 
Latin America, about 70 per cent in South and South- 
East Asia, and 43 per cent in North Africa. In the transi- 
tion countries (central European and former Soviet Union 
countries) 24 per cent of the labour force works in the 
informal-sector (OECD, 2009). 

Several arguments have been advanced for reassessing 
informal-sector employment. According to Fields (2005), 
the competitive labour market hypothesis suggests that 
informal-sector employment is likely to continue to be 
important. It can offer better working conditions than 
some formal employment, and, because of the lack of 
good formal-sector jobs, it is sometimes chosen voluntar- 
ily by workers. The phenomenon of jobless growth in the 
formal segments of the economy leaves countries with 
little choice but to make efforts to raise the potential of 
the informal economy. Sodhi (2014) highlights the im- 
portance of providing training to workers in the informal- 
sector. Wallenborn (2010) recognizes this in relation to 
the skills required for sustainable development and the 
need to adapt appropriate technologies. He notes that 
those countries with emerging industries and modern 
craft sectors require a kind of human capital and voca- 
tional skills that cannot be obtained solely through formal 
education, and also calls for hands-on non-formal and 
informal learning. 

Hart (1973), the International Labour Organization (ILO) 
(1972) and King (1996) draw attention to the heteroge- 
neity of the people living and working in the informal- 
sector. The ILO's definition of the informal economy 
comprises three categories: (i) small or micro-enterpris- 
es; (ii) household-based activities carried out by family 


members; and (iii) independent service activities including 
domestic helpers, cleaners, street vendors, shoe-shiners 
and so on (ILO, 1998, p. 168). The informal-sector is also 
sometimes divided into the ‘lower’ and the ‘upper' end 
(Krishna, 2005). The lower end isinvolved in subsistence 
activities and in low-productivity work. The upper end 
consists of a small but growing number of more dynamic 
productive informal micro-enterprises and entrepreneurs 
linked to larger markets, and utilizing 'modern' technol- 
ogy, for example in internet cafes or mobile phone call- 
centres. Different definitions of the informal-sector are 
used in different countries. In India, informal-sector en- 
terprises are considered to be a subset of the unorgan- 
ized sector ‘comprising in addition to the unincorporated 
proprietary and partnership enterprises ... enterprises 
run by cooperative societies, trust, private and limited 
companies' (National Accounts Statistics, NAS Sharma 
and Chitkara nd). 

While only a small percentage of informal-sector work- 
ers have received formal training (2.5 per cent of in- 
formal-sector workers in India: see NCEUS, 2005), 
employment-relevant competences are an important 
concept in the informal sector (Overwien, 1997). These 
include both the acquisition of technical skills and abili- 
ties that applied on the level of the individual enterprise 
and related in varying ways to the production process 
in an enterprise, and the acquisition of organizational, 
small-entrepreneurial and social competences that are 
external to the production process in an enterprise. For 
waged workers in the informal sector, manual and tech- 
nical skills and the ability to make contact and commu- 
nicate with others are often sufficient. In the case of 
entrepreneurs, a broader package of skills is required 
(Overwien, 1997). 

Burckhardt (1997) divides social competences into two 
spheres: ‘inwards, directed towards individual personali- 
ty', and 'outwards, directed towards [the] other'. Together 
with approaches to the promotion and improvement of 
learning at work, learning within the social environment, 
which is useful in the work process, should also be given 
added emphasis (Sodhi, 2014). 

Policy-makers are now much more aware that the sup- 
ply of training outside the formal economy can be the 
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main pathway for skills acquisition and utilization. They 
are aware of the scale of such training, compared with 
formal technical and vocational education and training 
(TVET), and are attracted by the sheer size of the youth 
population that is involved in acquiring skills in this part 
of the private sector (King, 2011, p. 123). Concepts of 
further education and training need to be developed 
that take account of informal learning, recognize com- 
petences that have already been acquired, and encom- 
pass social and labour-market integration (Overwien, 
2011). Workers who have gained skills in these ways 
need have them certified so they will be recognized in 
the mainstream labour market. Any training endeavour 
has to integrate them fully into the formal, regulated 
system of qualifications. 

Evidence from the country case studies of national qual- 
ifications frameworks (NQFs) compiled by the UNESCO 
Institute for Lifelong Learning (UIL) for the first edi- 
tion of the Global Inventory of National Qualifications 
Frameworks (UIL, 2014) and the UIL Observatory of 
Recognition, Validation and Accreditation (RVA) of 
Non-formal and Informal Learning (UIL, 2015) show 
that NQFs based on learning outcomes, competencies 
and credits provide an opportunity for the certification 
of human resources in various domains of the informal 
sector, including the agricultural sector. 

NQFs based on learning outcomes can be used to struc- 
ture programmes and training pathways leading to the 
acquisition of qualifications in a more flexible manner, 
and to improve the general conditions of lifelong learn- 
ing. The learning-outcomes approach means that NQFs 
are capable of providing easier recognition of learning 
outcomes and competencies achieved by informal sec- 
tors in various environments, in formal, non-formal or 
informal learning contexts. 

Similarly, recognition and validation of competences and 
learning outcomes from non-formal and informal learn- 
ing assists in making visible the knowledge, skills and 
competences acquired within the informal sector, based 
on identification and evaluation of such knowledge, skills 
and competences. In this way, the aim is to enable better 
integration into the labour market or into further edu- 
cation and training. While NQFs facilitate recognition 


of prior learning (RPL), the success of NQFs will depend 
on the integration of learning outcomes from informal 
sectors into the framework, so that prior learning can 
be mapped against outcomes-based qualifications. The 
processes of prior learning are complementary to every 
qualifications system that aims to promote an approach 
to lifelong learning. 

The informal sector's contribution to gross domestic 
product (GDP) cannot be ignored. Rather, the informal 
sector with its productive skills has potential which needs 
to be made visible. The creativity and the competences 
of individuals could be utilized for social development, in 
both urban and rural areas. Thus, it is important for the 
individual and, equally, for society and the economy to 
identify and document available competences that have 
not been formally recognized. Apart from having an in- 
trinsic value for the individual, recognition and validation 
could encourage them to obtain further qualifications. 
The learning that is recognized could be transferable (to 
the formal sector), especially at the interfaces between 
the informal sector and the formal economy. RPL could 
reduce the amount of time taken to obtain certification, 
so that individuals need to spend less time away from 
the workplace. By formally acknowledging workers' skills, 
recognition could be a means of gaining opportunities 
for further learning and of enhancing employability and 
labour mobility. 

For the micro-enterprises in the informal sector, a bet- 
ter recognition of workers' skills could be a way to 
overcome skills shortages and match skills demand 
with supply. It could also provide an opportunity to im- 
prove the overall skill level and work performance of an 
industry operating in the informal sector. The nation 
could have a better-certified skilled workforce, an em- 
powered population, and mobile and multi-skilled peo- 
ple, which could attract investors to the micro-enter- 
prise sector. The skill level and educational attainment 
of the workforce help to determine their productivity 
and income level, and contribute to their adaptability 
in a changing environment. Recognition is also impor- 
tant in addressing the problem of individuals who leave 
school early. Recognition through certification could be 
granted even to those who exit prematurely from the 
secondary school cycle. 
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THE OBJECTIVES OF THIS CHAPTER 

The objectives of this chapter are, therefore, to examine 
commonalities and differences in formalizing approaches 
and to explore solutions linking NQFs to informal sector 
skills development in different national contexts, especially 
in low- and middle-income and emerging economies. The 
areas taken into account include: 

• a regulated system of qualifications based on learn- 
ing outcomes 

• opportunities for the recognition, validation and accredita- 
tion of outcomes from non-formal and informal learning 

• support given by competent bodies, with the 
involvement of the private sector 

• incorporating existing informal sector skills initiatives 
into the NQF 

• building bridges between the informal and formal sectors. 

The chapter also sets out key recommendations that take 
into account other drivers and levers which need to be 
put in place to make sustainable informal sector skills de- 
velopment and recognition happen. 

A REGULATED SYSTEM OF LEARNING OUTCOMES 
BASED QUALIFICATIONS 

Policy-makers in several countries with large informal 
sectors are becoming increasingly aware of insufficient 
recognition of existing skills and informal learning, which 
prevents labour mobility. Governments recognize that 
these shortcomings lead to a serious wastage of skills in 
the economy. As a result, in many countries the NQF has 
been specifically designed to address some of these chal- 
lenges in informal sector skills development. 

In Gambia, for example, the Gambia Skills Qualifications 
Framework (GSQF) aims first and foremost to target young 
people, employees, the self-employed and people working 
in the informal sector, as well as the long-term unemployed 
and illiterate people, from both urban and rural districts. 
GSQF will be a tool to help these target groups to graduate 
from public and private training providers and industry in as 
many occupations as possible with GSQF qualifications, and 
contribute to the economy of the country. 

In India, where the National Commission for Enterprises 
in the Unorganized Sector (NCEUS) estimated in 2005 
that there were 395 million workers out of a workforce 
of 423 million employed in the informal-sector (NCEUS, 
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2009), the National Skills Qualifications Framework 
(NSQF) aims to develop training programmes that lead 
to qualifications for people in the informal sector. India's 
NSQF supports RPL processes. These processes help clar- 
ify the meaning of the qualifications and make visible the 
learning outcomes and competences that are necessary 
in order to achieve the qualifications. Given the low levels 
of general education in the population, the NSQF has 
organized RPL at entry levels leading into levels 1 to 10 
of the qualifications framework (Mehrotra, forthcoming). 

In the Philippines, according to the National Statistics 
Office (NSO), around 2.8 million Filipinos, roughly 7 per 
cent of the population, are unemployed, while 8.5 million 
or 22.7 per cent of the working population are under- 
employed. The Philippine Qualifications Framework aims 
to address these problems, which are largely the result 
of a mismatch between the jobs on offer and the skills 
possessed by the workforce. Often, people are under- 
employed in the sense that there is not enough paid work 
for them, rather than that they are doing work that does 
not make full use of their skills and abilities. In Uganda, 
the most important sub-sectors of the labour market are 
the informal economy and the agricultural sector. Some 
70 per cent of the Ugandan workforce continues to work 
in agriculture. Employment in the non-agricultural infor- 
mal sector (comprising mainly micro-enterprises, own- 
account workers and unpaid family workers) accounts for 
18 per cent of total employment and 58 per cent of non- 
agricultural employment. 

In Mexico, the recognition of labour competences for 
workforce development and employability is closely asso- 
ciated with the National System of Competency Standards 
(NSCS), which has been developed by the National 
Council for Standardization and Certification of Labour 
Competences (CONOCER) and under which the recog- 
nition of non-formal and informal learning is organized, 
regulated and implemented (Garcfa-Bulle, 2013). 

In Bangladesh, where major government line ministries 
have now accepted the National Technical and Vocational 
Qualifications Framework (BTVQF) as a model for the 
future development of qualifications, two prevocational 
levels have been established that cater to the underprivi- 
leged and low-educated groups in society who have not 
completed eight years of schooling. 

In India, the government's priorities for the NSQFare 
to make qualifications uniform and comparable and do 
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away with the differences in course content, entry re- 
quirements and duration of vocational courses across in- 
stitutions and states or union territories (UTs). This should 
make it easier to develop competencies that are useful 
in either waged or self-employment. A case in point is 
the 'certificate' course in plumbing (sometimes described 
as sanitary hardware fitting), which is offered in differ- 
ent places with a variety of durations and entry require- 
ments (Mehrotra, 2015). 

The NSQF will ensure a uniform system of skill stand- 
ards set by employers so that its workforce gets qual- 
ity VET opportunities that respond to the sector's 
wide-ranging and changing skill needs. More than 90 
per cent of the labour force is employed in the 'un- 
organized sector': that is, in jobs which do not offer 
social security and the other benefits associated with 
employment in the ‘organized sector'. India's Twelfth 
Five-Year Plan projects that about 25 million new en- 
trants will join the labour force in the next five years 
(India Planning Commission, 2013, p. 140). 

OPPORTUNITIES FOR THE RECOGNITION. 
VALIDATION AND ACCREDITATION OF OUTCOMES 
FROM NON-FORMAL AND INFORMAL LEARNING 

There is growing attention being paid to the recognition 
of the outcomes of non-formal and informal learning in 
the informal sector to promote decent employment and 
social equality. The lack of formal qualifications and 
certification makes workers vulnerable. They earn low- 
er wages, their productivity is low, they are exploited 
by their employers, and they are often disadvantaged 
in gaining access to formal education. 

An important area in the link between NQFs and infor- 
mal sector skills development is the approach taken to 
the validation and accreditation of learning outcomes 
and competences. A study in six African countries - 
Ghana, Mauritius, Seychelles, Botswana, Namibia and 
South Africa - in preparation for the Association for the 
Development of Education in Africa (ADEA) Triennale 
in 2012 highlighted the role of recognition and valida- 
tion of non-formal and informal learning as a means of 
the facilitating participation of informal-sector workers 
in formal education and training, and promoting their 
employability and mobility (Steenekamp and Singh, 
2012). There is also direct evidence from this and other 
studies (Singh and Duvekot, 2013) of the growing ap- 
preciation of the role that the NQF plays as an enabler 


for recognition and validation of non-formal and infor- 
mal learning. 

In Mauritius, the significant proportion of the labourforce 
who built their careers through apprenticeships without 
having undergone any academic or formal training are 
catered for under the Mauritius Qualifications Authority 
(MQF) through mechanisms for RPL. 

In Uganda, the Business, Technical and Vocational 
Training (BTVET) Act of 2008 makes provision for the 
assessment of prior learning (APL) against the Uganda 
Vocational Qualifications Framework (UVQF). Learners 
from training centres who have acquired skills in the 
informal economy will have the chance to rejoin the 
formal system. In order to meet the needs of informal- 
sector learners, occupational qualifications programmes 
within the UVQF are characterized by competence- 
based education and training (CBET) and flexible learn- 
ing modules delivered in the form of assessment and 
training packages (ATPs). 

In Ghana, validation of informal and non-formal learning 
is a key component of the NQF. As a first step, the lowest 
two levels of qualification, Proficiency I and II, recognize 
competences obtained via traditional informal appren- 
ticeships, an important means of training in Ghana. 

In Bangladesh, a project on RPL has been undertak- 
en with the International Labour Organization (ILO) 
(Arthur, 2009). Currently, about 80 per cent of new for- 
mal apprentices are enrolled in a National Training and 
Vocational Qualifications Framework (NTVQF) qualifi- 
cation with the Bangladesh Technical Education Board 
(BTEB); 90,000 informal apprentices are also registered 
for a qualification. These are people who have been 
assessed as competent in one or more standard units 
(making up a full qualification) through an RPL proc- 
ess, and who have the option in future to complete a 
full qualification (ILO, 2013). In Bangladesh, barriers are 
being removed for informal-sector skilled workers who 
want to migrate overseas, or who want to move back 
to Bangladesh and have the skills they gained overseas 
recognized. A number of host countries now recognize 
NTVQF qualifications. The processes of workplace learn- 
ing, recognition of learning and certification can be re- 
peated in several cycles until, after some years, the skilled 
worker is able to move into a supervisory role. This Mad- 
derization' system will be based on modularized compe- 
tency-based training within the NTVQF. 
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In Hong Kong, the major purpose of setting up an 
RPL mechanism under the Hong Kong Qualifications 
Framework (HKQF) is to enable workers of various back- 
grounds to receive formal recognition of the knowledge, 
skills and experience they have already acquired. However, 
many employers and trade unions take the view that if 
workers do not intend to pursue further education, there 
is no need to implement RPL. Whether or not to imple- 
ment RPL and how quickly to implement it are matters 
to be determined solely by the industries concerned. If 
industrial training advisory committees (ITACs) think that 
the implementation of RPL will do their industries more 
harm than good, they may opt not to implement it, or to 
hold discussions before proceeding with implementation. 

In Gambia, the GSQF benefits people in the informal 
sector. RPL is used for unemployed people seeking rec- 
ognition for past work or achievement, either for en- 
try into courses or for career development purposes; 
people who wish to 'upgrade' an existing qualification 
into a GSQ (for instance, by combining a previous cer- 
tificate with work experience); people who have left a 
programme before completion, and who wish to count 
that learning towards another award; and people with 
overseas qualifications who wish to gain a GSQ or cred- 
it towards one. 

In the eighteen years since the creation of the South 
African Qualifications Framework (SAQF), RPL has be- 
come a reality for over 500,000 people who have either 
gone through or are currently engaged in an RPL proc- 
ess. One of the main target groups is workers who may 
be semi-skilled and even unemployed, who may have 
worked for many years but were prevented from gaining 
qualifications because of restrictive policies. The great- 
est number of RPL candidates fall between NQF levels 2 
and 4, and do not, in the main, possess a school-leaving 
certificate. 

In Sri Lanka, RPL is defined as the process whereby 
competencies acquired through industry practice or 
previous training are recognized, allowing them to be 
put towards a certificate or credits. RPL is an important 
instrument for promoting NVQF-aligned certification, 
particularly in occupations for which demand is high. 
So far, the largest number of certificates issued through 
RPL has been awarded to beauticians, hairdressers 
and bakers. RPL is also especially important for people 
who want to work or study in other countries. There 
is no difference between certifications resulting from 
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accredited courses and those achieved through RPL. 
However, the award of a full qualification through RPL 
is limited to NVQF level 4. 

SECTORAL APPROACHES TO THE RECOGNITION 
OF OUTCOMES OF NON-FORMAL AND INFORMAL 
LEARNING 

There has been an increase in the number of sectoral ap- 
proaches to the recognition of outcomes of non-formal and 
informal learning. In India's agrarian informal sector, the 
Agriculture Sector Skill Council of India and systems set up 
by the National Skill Development Corporation (NSDC) have 
gathered master trainers and assessors together to form a 
panel, and trained them in supporting quality measures in 
the system. Certification is being linked with various finan- 
cial support incentives to increase the acceptability of certi- 
fied professionals in industry. To begin with, certification at 
the lower levels is being emphasized. Emphasizing commu- 
nity or entrepreneurial-based routes rather than employer- 
based routes via NSQF certification has also been proposed 
(Salooja et al., 2015). 

The construction sector is the largest sector in India's un- 
organized economy and the third-biggest employer af- 
ter agriculture and manufacturing, employing about 44 
million workers and contributing 6.67 per cent of GDP. 
About 86 per cent of the sector's workers have marginal 
skills or no skills, and, as a result, the productivity level is 
low. Sector skills councils (SSCs) are currently in the proc- 
ess of defining and classifying skills standards for com- 
mon trades such as mason, welder and carpenter, based 
on industry and client requirements. According to Saxena 
(2015), it makes more sense to the use the term ‘mapping 
of prior competences' (MPC) rather than ‘recognition 
of prior learning', as RPL is about learning while MPC 
is about competence - which means performance. The 
main aim of MPC is to relate the worker's skill to a sector 
standard which is universally acceptable in the industry. 

The sectoral approach to informal sector skills development 
is also reflected through the GSQF, which is adapted to the 
Gambian context where only half the workforce is literate. 
The framework caters for this informal -sector workforce 
in three ways. First, the foundation level acts as a stepping 
stone into entry-level occupational qualifications for early 
school leavers, adults and trainees with a non-formal train- 
ing background. Second, unit standards, particularly at levels 
1 to 3, are assessed through practical demonstrations rather 
than written assignments. And finally, skills standards include 
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key skills such as numeracy, literacy, English communication 
and ICT skills, practical occupational and business skills, and 
life skills. These skills are considered critical for eradicating 
poverty and promoting economic growth in Gambia. 

SUPPORT GIVEN BY COMPETENT BODIES WITH 
THE INVOLVEMENT OF THE PRIVATE SECTOR 

In several low-income and emerging economies, informal 
sector skills development is benefiting from the increas- 
ing involvement of industry and industry associations at 
national level in raising awareness of the importance of 
skill development and implementing the various strate- 
gies for skill development under the NQF. 

In several countries, SSCs are now driving skills develop- 
ment in the informal economy. In India, the private sec- 
tor, led by the National Skill Development Corporation 
(NSDC), established in 2009, has a mandate to skill 150 
million people by 2022 in twenty high-growth sectors 
identified by the Government of India. The NSDC is an 
umbrella body coordinating the SSCs, which are devel- 
oping qualification packs for different job roles. These 
contain national occupational standards or competency 
standards. In India, a paradigm shift from input-based 
education to learning outcome oriented education is tak- 
ing place. One of the initiatives under the NSQF is to 
develop outcome-oriented curricula and courseware with 
the involvement of professionals from industry and cur- 
riculum development experts. 

In the public sector, training can be expanded through 
strengthening non-formal schemes already operational 
at a local level. These schemes will succeed only when 
courses engage learners and find ways to make explicit 
the benefits of learning (Marsick et al., 1999). Local as- 
sociations of informal-sector workers could create a da- 
tabase of existing skills by undertaking skill mapping and 
assessing training needs on the basis of existing as well as 
potential industrial and employment trends. 

INCORPORATING EXISTING INFORMAL SECTOR 
SKILLS INITIATIVES INTO THE NQF 

In Pakistan, the NQF is designed to accommodate all 
kinds of TVET, whether formal, non-formal or infor- 
mal, delivered by both public and private providers. 
This is because Pakistan has an array of national and 
local training institutions and providers offering sev- 
eral short-term (three-month to one-year) courses, 


for which the entry requirement is a class 8 pass. 
However, to incorporate these diverse learning initia- 
tives into the NQF/TVET will be a challenge. One way 
of addressing this challenge is through the accredita- 
tion of training providers. 

Bangladesh is showing the way to accommodate and ac- 
credit training providers. Competency-based courses are 
registered with the BTEB. Approximately 50 per cent of 
training providers are registered with the BTEB and are 
delivering recognized competency-based training and 
assessment. Recently, the BTEB also accepted a compe- 
tency-based qualification for the training of trainers. As 
a result, industry-based trainers for the first time out- 
number TVET institution-based trainers. The BTEB is also 
implementing the Skills Quality Assurance System, and 
reports to the NSDC twice yearly. Private training provid- 
ers who wish to issue nationally recognized qualifications 
under the NTVQF must be registered and accredited un- 
der the new Bangladesh Skills Quality Assurance System 
(ILO, 2013). 

In India, the NSQF levels are linked to various skills de- 
velopment initiatives, such as Modular Employable Skills 
(MES). This competency-based training pathway under 
the Skill Development Initiative (SDI) of the Ministry of 
Labour and Employment has been designed to train work- 
ers and master craftspeople to upgrade their skills and 
adapt to new technological changes. MES offers many 
elements which are appropriate to the development of 
training for the informal sector. Workers are trained in 
formal institutions, or informally trained workers can take 
up a certification examination. There is a proposal by the 
Directorate General of Employment and Training (DGET) 
to offer facilities for workers to go through a ‘finishing 
school' before taking such an examination. Under MES, 
recognition and validation activities that recognize prior 
learning and existing skills, and customize further learn- 
ing, are a direct bridge between formal and informal 
learning because the module descriptors are included in 
the NSQF (DGET, 2008). 

STRUCTURAL CHANGES IN THE EXISTING 
TRADITIONAL APPRENTICESHIP SYSTEM 

Country case studies of NQFs show that countries are 
attempting to formalize the apprenticeship model of 
training practised in the informal sector. While the ap- 
prenticeship model is an important system of knowl- 
edge transfer, there are several criticisms levelled at the 
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traditional apprenticeship system. These include gender 
bias, screening out of the poorest households, perpetua- 
tion of traditional technologies, and lack of standards for 
quality assurance (Ahadzie, 2009). Examples from a sev- 
en-country survey conducted by the Agence Frangaise 
de Developpement (Walther and Filipiak, 2007) high- 
light the structuring of established practices of informal 
apprenticeship through the progressive introduction of 
interaction between practice and theory. Cameroon's 
Intersectoral Craftworkers Association (Interprofessionel 
des Artisans - GIPA) is currently structuring on-the-job 
training into progressive modules, which entail regular 
assessments and lead to a level of vocational qualifica- 
tion. Benin is converting the traditional apprenticeship 
system into a regulated dual training system (leading to 
a vocational skills certificate and occupational skills cer- 
tificate). As Walther and Filipiak (2007) point out, these 
changes retain the best aspects of learning while doing, 
while at the same time progressively incorporating a cog- 
nitive dimension of better understanding and improving 
what is learned by doing. 

BUILDING BRIDGES BETWEEN THE INFORMAL 
AND FORMAL SECTOR 

Several country studies show that laws and ordinances 
have been introduced to increase the permeability of 
the education and training systems in conjunction with 
the establishment of NQFs. In Mexico, the conception 
and development of Agreement 286 of the Ministry of 
Education (issued on 30 October 2000), and associated 
agreements, are designed to give workers and learners 
access to all levels of the education system by offering 
an alternative pathway to that provided by the formal 
system. In accordance with Agreement 286, CONOCER 
promotes the development of certifiable standards for 
recognizing the competences of employers and workers, 
accredits the assessment and certifications unit stand- 
ards, and issues official ‘labour competence certificates'. 
This Act also allows equivalences of competence certifi- 
cates with credits of formal education programmes at vo- 
cational and professional levels (Garcia-Bulle, 2013). 

In Ethiopia, strengthening progression pathways be- 
tween non-formal post-primary education and the 
TVET qualifications framework is one of the key ob- 
jectives of the Ethiopian NQF. The Federal Ministry 
of Education developed the Non-formal TVET 
Implementation Framework to facilitate this. In Kenya, 
progression pathways from primary to higher education 
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in the TVET sector are being promoted through the 
TVET Curriculum Development Framework (TCDF), 
which was established in 2010 according to Kenya 
Qualifications Framework (KQF) occupational stand- 
ards. This is helping to link youth polytechnics (YP) and 
vocational and industrial training (VIT) qualifications 
to formal TVET provision. In Nepal, a fundamental 
problem is the lack of permeability between education 
and training. Fifty per cent of Nepalese children do not 
complete primary school. However, attempts are now 
being made to link primary school to the TVET certifi- 
cations framework. 

NOT FORGETTING THE QUALITY OF FORMAL 
EDUCATION FOR INFORMAL SECTOR WORKERS 

King (2011) points to studies that show that the low levels 
of prior education and the low quality of formal education 
experienced by poorer members of the population have 
a negative impact on their access to and acquisition of 
technical and vocational skills, as well as their productiv- 
ity and access to higher incomes. In a similar vein, Adams 
(2011) shows that TVET pays off to a higher extent when 
graduates are placed in jobs that can use their skills. For 
disadvantaged persons, TVET is more effective when it 
builds on good-quality basic education. In Thailand, the 
vocational certificate curriculum (equivalent to lower sec- 
ondary education in the formal school system) and the 
non-formal occupational certificate curriculum are help- 
ing learners to complete secondary school by combining 
academic and vocational education, while, at the same 
time, serving the interests of various groups of people. 
In India, too, the necessary convergence between school 
education and the skill development schemes run by the 
various institutions and departments under different min- 
istries is helping to bring about a radical change in skills 
training, assessment and certification. 

KEY RECOMMENDATIONS 

The overarching recommendation for informal sector skills 
development is that it should take a lifelong learning per- 
spective. This means setting up effective mechanisms for 
assessing all types of learning, such as top-down NQFs and 
competency frameworks based on learning outcomes, as 
well as bottom-up mechanisms for recognition, validation 
and accreditation of learning outcomes and competences. 

Emphasizing the importance of qualifications for both 
competitiveness and poverty reduction: The enlarged 
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view of informal sector skills development should also 
emphasize the social dimensions of skills development. 
The fundamental question to ask is how qualifications 
can contribute to both poverty reduction and economic 
competitiveness, in addition to fulfilling educational tasks 
and objectives simultaneously (Wallenborn, 2007). 

Improving the quality of training: To break the cycle of dis- 
advantage, the poor in the informal sector need to access 
quality training and receive official certification for train- 
ing received and completed. Financing of provision should 
link to efficiency, attainment of minimum training stand- 
ards, and outputs, and offer incentives for performing well. 
Financing should not only focus on technical content, but 
adopt a holistic approach which includes post-training sup- 
port and follow-up programmes (King, 2011). 

Recognizing the limitations of conventional training 
programmes: Usually, workers in the informal sector 
need different pedagogical techniques which reflect 
what the trainees can handle. For example, the train- 
ers must be actual practitioners, possibly from the 
same socio-economic context as the trainees. They 
have to train in the local language, the ratio of trainees 
to trainers cannot be as high as in the formal sector, 
and training has to be conducted through hands-on 
demonstrations. 

Building a dynamic enabling environment: The produc- 
tive use of education and skills in the workplace de- 
pends on there being a dynamic or enabling environ- 
ment. In order to create decent employment in specific 
productive sub-sectors it is necessary to strengthen 
linkages between the informal economy and the larger 
market systems to transfer technologies, ensure access 
to credit and markets, and facilitate the dissemination 
of information. Equally important are linkages to the 
local economy (markets, infrastructures, job opportuni- 
ties and/or increasing self-employment opportunities) 
(Wallenborn, 2007). 

Monitoring quality indicators of TVET for the outcomes 
of informal sector skills development: Evaluation crite- 
ria for design, planning, implementation and the deliv- 
ery of training need to be measured in socio-economic 
terms, for example, higher productivity levels, bigger 
markets and new employment opportunities. Tracer 
studies can show whether training and skills develop- 
ment for the informal sector is producing better busi- 
ness perspectives. The overall indictors must be related, 


first, to a better socio-economic performance and, sec- 
ond, to the improvement of individual characteristics 
(Wallenborn, 2010). 

The outcomes-based approach to informal sector skills 
development should ensure that the employability cre- 
ated is manifested in measurable and tangible waged or 
self-employment of trainees. An online national register 
of skilled persons and their current employment is need- 
ed at the national level. This would provide a national 
database for employers and other stakeholders, and fa- 
cilitate a transparent monitoring system. 

Developing an understanding of the benefits and opera- 
tional aspects of NQFs amongst the various stakehold- 
ers implementing the skill development programmes: A 
clear understanding of what an NQF is (for example, it is 
a bridging device between different sectors or levels of 
education and training) and what it does (for example, it 
is a quality-assurance mechanism which can also lead to 
greater transparency in the education and training sec- 
tor) would help encourage the greater participation of 
people and the effective implementation of skill develop- 
ment programmes under NQFs. 

CONCLUSION 

NQFs in themselves do not make informal sector skills 
development and recognition a reality. However, the evi- 
dence shows that in terms of both national policy and 
institutional developments, developing NQFs means that 
the issue of informal skills development is much more vis- 
ible and transparent. 

There is clear added value in linking NQFs to informal 
sector skills development. Often, the benefits are implicit. 
Training centres, schools, local government and regions 
all undergo a process of change. Curricula and training 
plans are formalized. There is an opportunity to reflect in 
a new way on the value and attractiveness of education 
and training for the informal sector. There is new stimulus 
for public-private partnerships. Linking informal sector 
skills development to the NQF and recognition and cer- 
tification is not merely a technical integration but rather 
emphasizes the importance of flexible approaches that 
facilitate lifelong learning and career paths for individu- 
als, and permeability at system level. 

Author: Madhu Singh (UIL) 
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CHAPTER 4: NQFs AND REFORMING QUALIFICATIONS 


INTRODUCTION 

The European Training Foundation's (ETF) contribution 
to the first edition of the Global Inventory (Cedefop et 
al., 2013) examined how its partner countries, which are 
all transition economies, were developing, implement- 
ing and using their national qualifications frameworks 
(NQFs). We concluded that all the countries concerned 
were developing NQFs as reform tools, to produce more 
labour market relevant and lifelong learning (LLL) quali- 
fications, based on learning outcomes. Progress in imple- 
mentation was variable across the countries, naturally - 
implementation is always more difficult than design - but 
NQFs were accepted by all countries as key elements in 
a modernized LLL education and training system. At the 
same time, we found that no two NQFs were the same, 
in spite of similarities of design and many shared aims. 
National context varies and so the solutions adopted are 
- and indeed must be - specific to the country. 

An NQF - and, critically, its outcomes basis - implies ma- 
jor reform of a qualifications system and its environment: 
that is, the qualifications themselves, schools and pro- 
vision, curricula, assessment, quality assurance systems 
and governance, for example. And, so, in this chapter we 
look in more depth than we did in the first edition at 
what qualifications frameworks are for: producing better 
qualifications. 

Since 2013 most of ETF's partner countries have moved 
on from designing an NQF to begin implementation. 
Most have now legislated for their NQFs. Others have 
developed implementation plans and begun piloting. 
Another group comprises countries in the vanguard 
which have established dedicated authorities or agencies, 
or designated government departments, to lead change, 
and have begun to populate their frameworks with new 
outcomes-based qualifications. These are significant ad- 
vances, although change is uneven across countries, and 
is often patchy within them. 

This chapter identifies reform processes under way in the 
countries with which ETF works on vocational education 
and training (VET) qualifications system reform. We look 
at how countries are defining, developing and using qual- 
ifications, and analyse the anatomy of a qualifications 
system. Specifically, we examine whether those new 


or reformed qualifications are defined by learning out- 
comes; the use of occupational standards as the platform 
for qualifications design and development; NQF-driven 
quality assurance systems and measures; how govern- 
ments are engaging with their social partners within the 
environment created by NQFs; institutional roles; and the 
early impacts on curricula and assessment. 

QUALIFICATIONS FRAMEWORKS, FRAMEWORKS 
OF QUALIFICATIONS 

In ETF partner countries, frameworks and qualifications 
reforms, or new qualifications, are inextricably linked: no 
partner country is reforming its qualifications to produce 
new outcomes-based qualifications without using an 
NQF as the principal tool to effect this change. 

Countries are not doing so unthinkingly. They see that 
qualifications frameworks, in particular overarching and 
comprehensive frameworks (that is, those covering all 
types and levels of qualification), offer two things they 
need. First, they are based on learning outcomes so they 
are oriented to LLL. Second, frameworks are identifiable 
entry points to a national system, and so make interna- 
tional comparison easier. Let us look at why these two 
characteristics offer such appeal. 

It is worth reiterating the origin of this drive to develop 
NQFs. ETF partner countries have their reform needs, are 
exposed to influences beyond the European Union and 
might have come to NQFs in any case. But they would 
not have done so in such a brief timespan and developed 
the models of NQF that they have, without the European 
Qualifications Framework (EQF). 

Across the countries ETF works with, the EQF remains 
the inspiration for domestic NQFs. Its impact on those 
countries has been surprisingly rapid and far-reaching. 
Following the adoption by the European Union of the 
recommendation to establish an EQF in 2008, most ETF 
partner countries have emulated EU countries by devel- 
oping an NQF for LLL. The EQF is the technical model for 
twenty-six of the ETF's thirty partner countries that are 
developing and implementing an NQF. All are inspired by 
or, in some cases, based on the EQF's level structure and 
learning outcomes descriptors. Its definitions and con- 
cepts remain the starting point for ETF partner countries, 


GLOBAL INVENTORY OF NATIONAL AND 
REGIONAL QUALIFICATIONS FRAMEWORKS 


37 


and any discussion or text on NQFs implicitly looks to the 
EQF. Most critically, reform of the national qualifications 
system is invariably driven by the EQF-based NQF. 

Additionally, the EQF has become a reference to which 
partner countries wish to relate their qualifications sys- 
tems or frameworks. This influence, both technical and 
political, is an example of what we often call the EQF's 
external dimension. Among EU tools and policies in VET, 
or in education and training more broadly, the EQF is by 
far the most influential. 

WHY QUALIFICATIONS MATTER 

Almost all ETF partner countries are reforming their qualifi- 
cations. These reforms are part of wider VET system reform, 
but qualifications are a priority in ETF's partner countries to 
a greater extent than most other VET issues. Better qualifica- 
tions are necessary because, in a world of change and mobil- 
ity, learners and workers need a trusted way of demonstrat- 
ing their competence to perform a job. 

Qualifications establish the all-important links between the 
world of work and the world of education; they create a 
common language which is understood by both employers 
and schools. 

Of course, what employers want is skilled staff, so they are 
mainly interested in competences. But the labour market 
cannot function if employers have to carry out analyses 
in order to identify competences whenever they recruit 
new staff. Qualifications can signal that a person pos- 
sesses certain knowledge and skills. Therefore, employers 
have to make use of socially and nationally approved and 
recognized qualifications. These are, or should be, based 
on outcomes - and they should be competence-based. 

Qualifications do not only help individuals to get their 
first job. For many, changing jobs is a necessity, as is the 
need to stay up to date and change their occupation if 
necessary. Qualifications are needed that facilitate life- 
long learning and recognition of learning undertaken 
outside the formal education system. Traditional vo- 
cational qualifications (that is, those based on inputs, 
often inseparable from the curricula offered in certain 
institutions) and those with no pathways forward can- 
not do that. 


TRANSFORMED ECONOMIES, NEW 
QUALIFICATIONS 

ETF partner countries are societies and economies in 
transition. They face the same challenges as all other 
countries in the world but with the added obstacles of 
recent dramatic, sometimes traumatic, change. Borders 
have gone up, or states been dissolved, and new coun- 
tries have emerged. Countries have moved from (in most 
cases) state-dominated economies, characterized by big 
employers, to a much more complex picture of smaller 
enterprises, non-governmental organizations (NGOs) 
and foreign or international firms. 

These changes have challenged VET systems greatly. 
Frequently, the transition has stretched or broken the 
VET school-to-employer relationship. Countries have 
gone from mainly state-run VET systems, supplying com- 
mand economies with a stream of VET graduates who 
could expect to achieve stable employment, to a more 
complex economy with unpredictable job prospects and 
much more diverse VET provision. 

VET has often contracted. It has also suffered by default 
as higher education in many countries has accelerated 
out of control, absorbing masses of young people, often 
pushed by their parents along the supposedly more pres- 
tigious academic path. 

New providers in VET are often not trusted. The same 
applies to some new qualifications. Countries, and in 
particular their learners and employers, face a bewil- 
dering array of schools and qualifications, which they 
do not understand. 

WHAT WE TALK ABOUT WHEN WE TALK ABOUT 
QUALIFICATIONS 

This chapter is about the qualifications themselves and 
how NQFs can contribute to their quality. But we need to 
say first what we are talking about. ‘Qualification' means 
different things in different countries, or even within 
them. There is no universal definition, or understanding, 
of ‘qualification'. Linguistic differences apart, how quali- 
fications are perceived and defined varies. The term ‘vo- 
cational' is also open to interpretation, and in practice has 
quite different usage and meaning across countries. 
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We want to be practical, so let us assume for our pur- 
poses that all countries have qualifications, vocational 
and otherwise, even if they do not conform fully to inter- 
national definitions. But even these 'international' defi- 
nitions vary. The International Standard Classification of 
Education (ISCED) definition links qualifications to com- 
pletion of a programme; by contrast, the EQF definition 
defines a qualification as ‘the formal outcome of an as- 
sessment and validation process, which is obtained when 
a competent body determines that an individual has 
achieved learning outcomes to given standards'. 1 

In many parts of the world, governments, schools and 
employers now consider what a person has learned to 
be more important than what they have been taught. 
The EQF definition is now in the ascendent in ETF part- 
ner countries. That said, many partner countries, while 
developing NQFs based on learning outcomes, have not 
yet redefined what 'qualification' means. Most use defi- 
nitions which would not comply with the EQF one. In 
most cases, this is simply a practical matter. Reform is 
under way but not every part of the system will be re- 
formed at the same time or systematically. Change is, in 
reality, piecemeal. Revising or introducing legislation is a 
cumbersome process, so we should not be surprised if 
practice is ahead of theory, especially where this is em- 
ployer-led, as it is, for example, in Ukraine. 

Let us now look at some country examples. In Morocco, 
no definition is used nationally. In practice, until recently, 
no distinction was drawn between certification or com- 
pletion of a programme. But Morocco has adopted an 
NQF (by agreement; legislation is pending) whose level 
descriptors are outcomes-based. Indeed, the country 
uses the approche par competences (APC) approach 
for design of VET programmes, based on analysis of the 
work situation and occupational standards. Thanks to the 
APC, Morocco is gradually mainstreaming the learning 
outcomes approach in VET, a fundamental factor for im- 
plementation of the NQF. 

In Egypt, a qualification equates, simply, to a certificate. 
A subdivision is used: qualifications awarded by the min- 
istries of education and industry and commerce are 'for- 
mal', while those issued by other ministries are 'informal'. 

1 Recommendation of the European Parliament and of the 
Council of 23 April 2008 on the Establishment of the 
European Qualifications Framework for Lifelong Learning. 

2 Law on National Qualifications 2008. 
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Serbia, meanwhile, plans to use an EQF-derived definition, 
appropriate to its NQF plans. Kosovo's definition recog- 
nizes completion of a course of education or training or 
satisfactory performance in a test or examination'. 2 While 
this is close to ISCED's definition, inclusion in the country's 
NQF is conditional on the qualification itself beginning 
with learning outcomes. Azerbaijan and Turkey refer to ac- 
quisition of skills and competences and their recognition by 
authorized bodies, which approaches the EQF definition. 

So the direction of travel is evident: countries worldwide 
are moving to outcomes definitions and building out- 
comes-based NQFs, atrend of which ETF partner countries 
are a part. As indicated earlier, EU instruments are central 
to shaping and channelling this policy and to driving sub- 
stantial change. As well as the EQF, the European Credit 
System for Vocational Education and Training (ECVET), 
Europass, Education and Training 2020 (ET 2020), the 
Copenhagen Process and the Bruges Communique all 
exercise their influence on countries' discussions and de- 
cisions. Learning outcomes are the conceptual common 
denominator of all these tools and policies. 

What we have found, is that definitions are often out of date 
in their intention, and sometimes, where reform is more ad- 
vanced, in their practice. Some countries are reordering the 
relationship of curricula to qualifications, so that qualifica- 
tions are designed by learning outcomes and curricula are 
developed to facilitate achievement of these. 

We should say a word here about vocational qualifications 
at higher levels. Countries vary in the levels at which their 
VET qualifications are available. In some cases a ceiling is 
applied, so that such countries do not, or do not yet, offer 
VET qualifications beyond the equivalent of EQF levels 4 
and 5. In other cases, such as Turkey, or in the sectoral 
frameworks in Russia, VET qualifications are available at 
the upper levels. In others, the new NQF upper levels are 
equally open to VET qualifications but no qualifications in 
VET beyond levels 4 or 5 have yet been developed. 

NEW TYPES OF QUALIFICATIONS ARE EMERGING 

NQFs are behind another key trend in the conceptual 
development and implementation of new or revised 
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qualifications. Traditionally, vocational qualifications and 
programmes in most partner countries were almost ex- 
clusively offered in initial or secondary school. Adults, 
whether in work and retraining or not in employment and 
seeking to re-enter the workforce, were not catered for. 

But a more complex economy requires a wider range 
of qualification types to meet learner needs. Types are 
clusters or categories of qualifications, which share 
characteristics such as the sub-system they belong to 
(for example higher education or VET), their objectives, 
purpose, and the learner group they cater to. We can 
also think of types, in everyday language, as a way of 
indicating how qualifications can be like each other and 
how they can be different from each other, in duration, 
profile, content and so on. When countries define types 
of qualifications, this is integrated into the NQF, so that 
qualifications inserted in the NQF are first defined by 
type. 

Kosovo orders its framework in this way, and is currently 
redefining its types into six categories, to reflect the cur- 
rent availability of qualifications. Its range includes na- 
tional vocational qualifications (NVQs), which must be 
derived from approved occupational standards, higher 
education qualifications, combined general and voca- 
tional qualifications, and so on. Its vocational training 
centres, run by its Ministry of Labour, offer courses for 
jobseekers that lead to qualifications. 

Turkey offers a range of types, including NVQs issued 
by the Vocational Qualifications Authority, and the 
Vocational Associate Degree. Ukraine offers junior spe- 
cialist and specialist-level diplomas. Russia offers retrain- 
ing certificates for adults. 

Economic change and globalization make lifelong learn- 
ing a necessity to prepare people for modern employ- 
ment. A variety of types of qualification is therefore 
essential. Partner countries are paying more attention 
to this issue now, recognizing that clear definitions and 
categories aid the design of qualifications and establish 
the relationships and pathways between them. 

UNIT-STRUCTURED QUALIFICATIONS ARE 
INCREASINGLY COMMON 

The LLL paradigm has also encouraged a restructuring 
of qualifications, building on the new thinking about 
learning outcomes which has been influencing partner 


countries for six or seven years. More countries now look 
to build their qualifications on units. Of course, when 
qualifications were indistinguishable from curricula, there 
were no unit-based qualifications. 

Unitized qualifications can be offered to learners either 
in combinations or singly. We should not think of 'par- 
tial' qualifications, which implies something less than a 
full qualification. Instead, it is important to appreciate 
how units offer flexible options to learners. For exam- 
ple, comprehensive, unitized qualifications can be de- 
livered via a regular, full programme in initial VET, while 
adult learners and those in retraining may prefer more 
readily manageable unit-by-unit learning, allowing for 
flexible and accessible assessment. In this way, units 
support a more adaptable workforce, and crucially are 
by their nature sympathetic to LLL. Countries usually 
specify criteria for qualifications design, including units, 
in their NQF requirements or guidance. 

Take-up of this approach varies across the area that 
ETF serves. In the Balkans, there is receptivity to units: 
Serbia and Kosovo are adopting unitized qualifications. 
The criteria set for the development of such units in- 
clude demand in the labour market. But in the North 
African countries, qualifications are generally still ‘solid’ 
as the countries do not consider units as qualifications 
in their own right. 

OCCUPATIONAL STANDARDS - ENSURING 
LABOUR MARKET RELEVANCE 

Vocational qualifications should be developed from iden- 
tified labour market needs. In ETF partner countries in 
Eastern Europe and the Balkans, this often means re-es- 
tablishing links with labour markets that have been broken 
during the transition and upheaval of the past 25 years. 
Or, to be more accurate, it means building new links with 
today's greater diversity of enterprises and employers. 

In the past, VET systems in these two regions would of- 
ten (to simplify) funnel graduates directly to assigned 
employers in a heavily regulated labour market; or, rather, 
demand and supply were so strictly regulated that there 
was not much of a labour market. Training was curricula- 
driven and tended to be narrow and specialized, with lit- 
tle space for career planning or core skills. The transition 
to an open market ended many of these jobs and broke 
the VET-employer link. Curricula and qualifications have 
been slow to match these changes. 
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Three out of four of ETF's partner countries now use oc- 
cupational standards to develop vocational qualifications. 
Both DACUM (developing a curriculum) and functional 
analysis approaches are in use: for example, Moldova, 
Serbia and Jordan use DACUM, while Russia, Ukraine and 
Egypt use functional analysis. The principal value of stand- 
ards is in seeking to incorporate labour market needs. 

A standard is a measurable indicator of achievement. An 
occupational standard is a document which specifies the 
performance requirements in an occupation, and so links 
qualifications to employment. Most partner countries have 
traditionally used education standards to define qualifica- 
tions. Education standards measure the quality of the edu- 
cation process and the outputs of an education system. 

Occupational standards in ETF partner countries are often 
developed by sector skills councils (SSCs), chambers of com- 
merce or international donors. In Turkey, tripartite sector 
committees develop the standards, supporting the labour 
market relevance of the derived qualifications. Moldova 
has devised its occupational standards via its SSCs. 

Non-EU countries use occupational standards in different 
ways, of course, just as EU countries do. Turkey's NVQs 
are derived directly from occupational standards, so one 
standard leads to one qualification while information from 
several standards can be used to develop broader-based 
qualifications more suited to prepare secondary VET learn- 
ers for several related occupations. Or units from occupa- 
tional standards can be used to develop units of vocational 
qualifications for specific skills, especially in retraining. 

While the spread of occupational standards is welcome, 
too often many remain outside national qualifications 
systems, so that standards created or led by donors re- 
main unused by qualifications developers in the coun- 
try. Indeed, some countries have scores of occupational 
standards but only a handful of approved qualifications, 
as bureaucratic bottlenecks prevent the validation of 
more standards. Countries might seek to harness stand- 
ards to national qualifications more efficiently by stream- 
lining the approved development processes. 

QUALITY ASSURANCE AND GOVERNANCE 

As countries undertake the move to LLL qualification sys- 
tems, and outcomes-based NQFs, so the types of quali- 
fication, and the number of providers and qualification 
developers, increase. 
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This range of diverse qualifications, developed or offered 
by VET schools, HE, private providers and NGOs, has cre- 
ated more of a market, meeting learner and employer 
need more broadly. This progress is to be welcomed. But 
there is also a more complex situation now, so that there 
is a need for proportionate regulation. New qualifica- 
tions have appeared but are not always trusted or used. 
Countries are trying to ensure these qualifications have 
value, so this implies reform to governance and quality 
assurance systems. 

These processes are going on in ETF partner countries, 
and are driven by NQFs. NQFs set quality criteria for de- 
velopment of a qualification by providers; they set crite- 
ria for validation and for inclusion in the framework; and 
they establish quality assurance requirements for assess- 
ment and the accreditation of providers. In governance, 
NQFs act as platforms for social dialogue. SSCs usually 
emerge as actors via the NQF. 

In Georgia, ministries and authorities specify criteria for 
the inclusion of qualifications in the framework and as- 
sociated registers. These criteria include demand from the 
labour market, participation of labour market actors and a 
basis in occupational standards. Decisions on inclusion in 
the NQF are made by the National Centre for Educational 
Quality Enhancement. Kosovo applies similar criteria, and 
VET qualifications should be unit-based to enter the NQF. 

There is also the question of how flexible or how tight 
regulation should be, which is determined by the balance 
of powers or responsibilities between the stakeholders. 
Cedefop, in its 2009 study, The relationship between 
quality assurance and VET certification in the EU mem- 
bers states, identified three broad models of quality as- 
surance: prescriptive systems, which tightly define the 
roles of the actors involved in the development and deliv- 
ery of qualifications and which are led by central govern- 
ment; cooperative approaches, which divide responsibili- 
ties using common guidelines; and self-regulated models, 
which allow actors to pursue their own paths. 

In ETF partner countries, the presence of many actors in 
qualification development means that tight regulation is 
necessary and should have a legal basis, so it is given the 
weight traditionally given to law in education and training. 

Quality, of course, is also a matter of who. Qualifications 
are social constructs, the value of which rests on broad 
social recognition and acceptance, in particular from 
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employers. This is why engaging employers and trade 
unions via bodies such as SSCs is so important. 

Many partner countries have or plan SSCs, which carry 
out a range of functions in VET, including informing the 
development of occupational standards and new qualifi- 
cations. SSCs are platforms for cooperation where social 
partners from the relevant sector, VET school representa- 
tives, experts and other stakeholders work together to 
channel labour market input to education and training. 
ETF's Eastern Partnership countries have been promi- 
nent in establishing SSCs: Armenia, Georgia, Moldova, 
Azerbaijan and Ukraine have all done so. 

In some other countries, perhaps where the economy is 
less developed and social partners are less organized, the 
role played elsewhere by SSCs is taken up by chambers 
of commerce or individual social partners and companies. 
However, the more structured, established and long-term 
commitment of SSCs is preferable to a more ad-hoc in- 
volvement of social partner actors, who can be disadvan- 
taged in discussions with ministries and experts. 

One other observation concerns the intersection of qual- 
ity assurance and governance. Some countries have es- 
tablished dedicated single authorities as executive bodies 
reporting to ministries, as opposed to an office within 
a ministry, to guide implementation of the framework. 
These new agencies can better regulate the proliferation 
we have spoken of, but there are wider benefits. A spe- 
cialized agency staffed by qualifications experts enables 
a country to become more self-reliant in this field, build- 
ing its own capacities and growing less susceptible to do- 
nor or other external pressures. 

ASSESSMENT IS DIVERSIFYING BUT SLOWLY 

We have so far spoken of what makes a good qualifica- 
tion. But design, composition, governance and measures 
to ensure quality need to be accompanied by more di- 
verse assessment and by changing learning practices if 
qualifications are to benefit individuals. 

Assessment and certification link a qualification to an indi- 
vidual. Assessment is also the basis of employer trust in the 
qualification presented by the applicant. Without credible 
assessment, qualifications will not benefit the holder. 

To generalize, ETF partner countries in the past assessed 
learners against the content of the available curriculum. 


As everyone studied the same content, assessment mainly 
served to compare differences in knowledge and skills be- 
tween learners. But the development of outcomes-based 
qualifications has implications for assessment, validation 
and certification. To be awarded a qualification based on 
learning outcomes, a learner needs to demonstrate com- 
petence against a relevant qualification standard. 

Further, different types and different ‘markets' of qualifi- 
cations imply that we should not assess all learners in the 
same way. There are two issues here. 

First, outcomes-based qualifications enable teaching and 
learning to be separated from summative assessment, al- 
lowing learners to be assessed differently according to 
their pathway. An increasing number of learners under- 
take adult education, retraining or learn at work to acquire 
the competences needed to be awarded a qualification, 
and these routes require different assessment methods 
and tools. They need to depart from the monopoly of the 
traditional final exam to encompass observation, stimula- 
tion, evaluation of ‘real life' practice and so on. 

Second, because these more varied assessment meth- 
ods are now being used to assess for outcomes-based 
qualifications, more attention is being paid to assessment 
standards - including assessment criteria, procedures, 
guidelines and minimum requirements - in order to en- 
sure the validity and reliability of assessments. 

To ensure relevance of standards, it is important to de- 
fine them with the input of professionals in the field. 
Social partners, beyond their role at the beginning of the 
qualifications process (that is, in development), are also 
important in assessment. Their involvement strengthens 
the quality and relevance of qualifications, thus boosting 
their appeal to learners. In Turkey, industry sectors can 
become authorized certification bodies for standards- 
based qualifications via, first, International Organization 
for Standardization (ISO) accreditation, and then authori- 
zation by the vocational qualifications authority (VQA). 
The VQA then issues national certificates for these sec- 
tor-led assessments. 

Another trend is toward more external assessment, as 
opposed to teacher assessment. Some partner countries 
have introduced recognition of prior learning (RPL) or 
validation of non-formal and informal learning (VNFIL). 
VNFIL supports reform of qualifications, increases 
the transparency of qualifications systems, supports 
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outcomes-based qualifications and more varied assess- 
ment methods, and widens access to qualifications. It also 
offers scope to recognize the skills of returning migrants, 
who are numerically significant in most partner countries. 

Serbia, Kosovo and Montenegro all have RPL systems 
in their legislation, and some candidates are certified 
via RPL. Other partner countries, such as Morocco and 
Tunisia, have piloted RPL in industrial sectors such as tex- 
tiles. But aside from Turkey, the numbers of applicants 
remain small, and the range of qualifications for which 
validation is available is limited for the time being. In 
many cases, the lack of qualifications standards against 
which to assess and certify, and a continuing lack of in- 
frastructure (for instance, an adequate number of trained 
assessors), remain barriers. 

THE QUALIFICATIONS-TO-CURRICULA 
RELATIONSHIP IS CHANGING 

We noted earlier the often inextricable link between quali- 
fications and curricula in many countries in the neighbour- 
hood of the European Union. Curricula were often very 
tightly prescribed and centralized, and narrowly special- 
ized. And just as 'qualification' has different meanings, so 
has ‘curriculum' in different countries. But for our purposes 
we understand it to mean the measures, interactions and 
experiences within an organized learning process. 

The upheavals of twenty-five years ago often broke tra- 
ditional VET-employer links in Eastern Europe and the 
Balkans. One consequence was to confine ‘training' to 
schools, with an inevitable rebalancing towards theory over 
practice and perhaps too many general subjects, thusdilut- 
ing VET. VET has sometimes suffered a further relative de- 
cline as numbers of students increase in general education. 
Additionally, VET curricula often remain supply-driven, de- 
termined by available provision and equipment rather than 
by labour market or learner need. 

However, in recent years, a countervailing trend to link 
qualifications better to employment needs has been facil- 
itated by outcomes approaches in qualifications and cur- 
ricula, and the spread in use of occupational standards. 
Defining qualifications by outcomes, which must fit the 
NQF descriptors, enables authorities to develop curricula 
more geared to equipping learners with skills relevant to 
work. This system is more transparent, more flexible in 
the range of teaching and assessment it allows, and more 
responsive to changing employment needs. 
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There are moves to use qualifications as the starting point 
for learning. NQF level descriptors influence qualification 
type descriptors, which in turn inform individual qualifica- 
tions, which have associated learning outcomes and assess- 
ment criteria. It is important that the learning outcomes 
originate from workplace competences, rather than the 
curriculum. Learning modules and curricula are then devel- 
oped to support students in achieving the outcomes, rather 
than the curriculum driving the learning process. This also 
allows qualifications and curricula to be separated. 

Moving to outcomes-based curricula is easier in continuing 
VET (CVET), as curricula can draw on occupational stand- 
ards more readily than in initial VET (IVET), where schools 
need to offer younger learners a wider range of subjects in 
addition to more narrowly occupational skills. 

That said, impacts of qualifications reforms and NQFs on 
teaching and learning appear, so far, to be weaker than in 
defining qualifications, designing an NQF, identifying the 
country's relevant stakeholders and initiating new quality- 
assurance measures. 

FINDINGS 

Most partner countries now have some or most of the 
necessary elements of a modernized qualifications sys- 
tem in place. Many have passed legislation, developed 
quality assurance systems to regulate the new system, 
and developed occupational standards. But in most cases 
NQFs remain empty of qualifications, and universally the 
urgent need is to populate these frameworks. 

Occupational standards are used in most partner coun- 
tries; indeed, some countries produce significant numbers 
of such standards, thus providing potential relevance to 
qualifications. But many are generated by donors, who 
can produce them, to be picked up by employers, without 
regulation or final approval by the national government. 
Qualifications, by contrast, usually require heavier proce- 
dures, and so progress is slower. Development processes 
should allow for occupational standards to more readily 
be linked to qualifications. Qualifications need to mean 
something to learners and employers, to have recogni- 
tion. A diversity of qualifications should not be a reason 
for a lack of transparency. Instead, qualifications should 
be developed that are eligible for inclusion in the NQF, 
and meet its quality criteria. In this way, NQFs support the 
development of a properly national qualifications system, 
in which qualifications have a national value or currency. 
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LLL characteristics are emerging. Some countries have 
developed a range of types to meet a wider spectrum of 
learner needs in new economies, while units are the basis 
of qualifications in some Balkan countries, in particular. 

NQFs are promoting quality assurance. Indeed, where 
criteria are set for qualifications development and valida- 
tion, and for assessment, NQFs are invariably the instru- 
ment that sets these criteria. At the same time, quality 
assurance is still often thought of in terms of quality- 
assuring the provider - that is, accreditation - but this, 
alone, is not enough to guarantee the quality of indi- 
vidual qualifications. Quality assurance should also apply 
to approval of the qualification for inclusion in the NQF 
and to assessment. 

Countries recognize the essential role of the labour market 
in developing qualifications, and, in some cases, support- 
ing assessment. To date, some countries have systemized 


employer contributions via SSCs or similar bodies, but in 
others this engagement remains ad hoc. 

Assessment methods have been slow to change, but in- 
troducing an NQF and outcomes-based qualifications 
means that assessment needs to be more varied, and 
based on agreed standards. RPL is being introduced in 
some countries, but the number of qualifications for 
which it is applicable is still limited. Learning-outcomes 
approaches in qualifications are exercising an influence 
on curricula, reducing centralization and moving toward 
more locally adapted implementation among providers 
better linked to identified employment needs. 

All these changes are usually slow and patchy, and are in 
their early stages. That said, there is no doubt about the 
direction of travel. 

Authors: Michael Graham and Arjen Deij (ETF) 
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CHAPTER 5: CHANGING LEGAL AND INSTITUTIONAL 
ARRANGEMENTS AS A CONSEQUENCE OF QUALIFICATIONS 
SYSTEMS REFORMS 


This chapter explores the functions of legislation and 
other forms of regulation and the roles of institutions 
in qualifications systems. We look at the purposes and 
scope of legislation and regulation, and identify what 
institutions shape qualifications systems, what functions 
they have and what relationships they have with each 
other and with other actors in education and training. 
Most modern qualifications systems are now built around 
national qualifications frameworks (NQFs), so these is- 
sues are inextricably linked to the individual NQF's char- 
acter, aims and functions. 

To date, these legal and institutional aspects of NQFs 
have received perhaps less attention than other dimen- 
sions such as learning outcomes, quality assurance ar- 
rangements, the potential of NQFs to better link qualifica- 
tions to the labour market, and international referencing. 
Therefore, it is timely to examine this key area of NQFs 
and the implications for the arrangement of qualifications 
systems and wider education and training systems. While 
in the European Training Foundation (ETF) our remit is 
our thirty partner countries, other systems are covered 
here to illuminate diverse approaches we have identified. 
(ETF's partner countries are often also called transition 
countries: that is, they are reorienting their economies 
and changing from a centrally planned economy to a 
market economy.) 

ETF partner countries are generally dissatisfied with their 
qualifications, which are usually out of date, inputs- 
based and lack value in the labour market. They seek to 
address these deficits by reform. A starting point is the 
legal act that regulates the NQF. These acts often set the 
objectives, indicate the NQF levels and reference special 
institutions that may have a role in supporting the imple- 
mentation of the NQF. In most transition countries, leg- 
islation is necessary to initiate any system-wide reform. 

While ETF's thirty partner countries have different his- 
tories and different demographic challenges, the great 
majority are introducing or implementing qualifications 
frameworks. We need to know whether the scope of 
the legislation varies, or, conversely, if the ambitions set 
for NQFs, which are often similar (for instance, lifelong 


learning, introducing new quality assurance systems, la- 
bour market relevance, progression and recognition of 
prior learning [RPL]), result in similar legislation. What 
other factors influence the legislation and development 
of institutional roles? 

PURPOSES OF NQFs, PURPOSES OF LAWS 

David Raffe, distinguished between communicating 
frameworks, transformational frameworks and reforming 
frameworks (Raffe, 2009). A communicating framework 
takes the existing system as its starting point, and aims 
to make it more transparent as a basis for rationalization, 
improving coherence and developing progression path- 
ways. At the other end of the spectrum is the transfor- 
mational framework, taking a proposed future education 
and training system as its starting point and defining the 
qualifications it would like to see in a transformed sys- 
tem, without explicit reference to existing provision. 

Halfway between the communicating and the transfor- 
mational frameworks is the reforming framework, com- 
bining some features of both other types. A reforming 
framework starts from the existing education and training 
system and its institutions, but then focuses on specific 
reform objectives - for example, making sure all qualifica- 
tions are developed from identified needs and quality is 
assured in a consistent manner. These reforming frame- 
works are part of wider education and training and/or la- 
bour market reforms, and tend to be regulated to try to 
drive change directly as well as to facilitate change agents. 

According to Raffe's criteria, the early South African and 
New Zealand frameworks were transformational frame- 
works, the Irish framework a typical reforming frame- 
work and Scotland the archetype of the communications 
framework based on incremental steps agreed by its 
founding partners (Raffe, 2009). 

Legislation becomes more important when qualification 
system reforms imply important changes to the status 
quo. Legislation can help a country to formally adopt 
the framework and to create common legally binding 
principles for its implementation. Our analysis of early 


GLOBAL INVENTORY OF NATIONAL AND 
REGIONAL QUALIFICATIONS FRAMEWORKS 


45 


legislation in different countries shows that legislation is 
seldom comprehensive at the start, and where it tries to 
be comprehensive it can create difficulties in implemen- 
tation if it imposes detailed arrangements that are not 
tested. 

The legislation is a tool to support implementation, not 
a goal. The introduction of a qualifications framework 
implies that qualifications are coordinated and, in many 
cases, quality-assured in order to increase trust. These 
common coordination and quality-assurance functions 
can be enhanced by establishing new institutions to sup- 
port the coordination between different stakeholders and 
to ensure common quality-assurance principles. Trust in 
qualifications can be further strengthened by making 
qualifications more relevant for the labour market and 
formalizing the dialogue with the world of work. 

Ultimately, the objectives of the qualification-system re- 
forms determine how influential and far-reaching in its 
impacts the NQF will be. When the objectives are re- 
formist - for example, to actively promote lifelong learn- 
ing, to open up closed systems under the control of in- 
dividual providers and provider networks, to establish 
new mechanisms for RPL, to establish new principles 
for quality-assuring qualifications, or to bring in labour- 
market actors - then the power balance between stake- 
holders shifts, requiring a sharing of responsibilities and 
mutual agreement among established stakeholders and 
new actors. 

STRIKING A BALANCE OF POWER 

Stakeholders from the provider side will have to surrender 
some control over the content of qualifications and how 
they can be obtained, while stakeholders from the world 
of work gain influence. In order to be successful, quali- 
fication-system reforms require that all stakeholders are 
mobilized and involved, and that they are aware of the 
objectives and take ownership of the necessary changes. 
A dialogue between stakeholders is a necessary pre- 
condition for successful reforms. It is unlikely, however, 
that all changes will happen voluntarily, be implemented 
through mutual agreement, and that all stakeholders will 


be equally motivated even if a win-win situation can be 
created for all, with the prospect of more people partici- 
pating in learning. Legislation is often needed to create 
new conditions, stimulate new developments, and reg- 
ulate roles and responsibilities, in particular in market- 
oriented or state-led skill-formation systems (see below) 
where the governance of such systems is not determined 
by social dialogue. 

DEGREES OF REGULATION 

Legal traditions certainly influence how qualifications are 
regulated. In the English-speaking world, where common 
law has been built incrementally around individual cases, 
governments have been less inclined to legislate (pre- 
scribe) what qualifications should look like. In countries 
that have a civil code, the tradition of state regulation 
based on logical principles has facilitated the creation 
of ruling principles for qualifications rather than letting 
qualification systems evolve around individual cases 
(Merryman, 1985). In Central European countries such 
as Germany and Austria, where social partners play an 
important role in setting the conditions for qualifications, 
and the entitlements that can be obtained from holding 
a qualification, qualifications standards for the dual vo- 
cational education system are compulsory and have the 
power of law. Civil effect, the legal entitlements qualifica- 
tions can provide once they are recognized as equivalent 
to existing ones, is an important issue for countries where 
qualifications are subject to government regulation. 

FUNCTIONS OF QUALIFICATIONS 

Qualifications are not only important as formalized 
outcomes of education and training systems. In the 
Soviet Union and Yugoslavia, qualifications were an 
integral part of the labour market regulatory systems, 
determining the jobs people were assigned to, as well 
as salaries, pensions and opportunities for career de- 
velopment and mobility. These regulated labour market 
functions of qualifications are again becoming an issue 
in current qualification system reforms, with the intro- 
duction of labour market specific qualifications to cer- 
tify competent workers. In Estonia, more than 15 per 
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cent of the labour force has already obtained profes- 
sional qualifications based, on occupational standards, 
by the time they leave the education system. In Turkey, 
certification of unqualified workers in more than 100 
occupations is currently becoming compulsory. 

SKILL FORMATION MODELS SHAPE THE RANGE 
OF QUALIFICATIONS 

Qualifications systems are socially and historically de- 
veloped constructs, and an integral part of national skill- 
formation systems. International literature (Geinert, 
2010) on skill-formation systems in industrialized coun- 
tries distinguishes between four models of skill-forma- 
tion system. Collective skills formation with a leading 
role for social partners is predominant in Central and 
Northern Europe, where social partners agree on a re- 
stricted number of high-value qualifications that are 
formulated jointly. Market-based skill-formation mod- 
els, present in the Anglo-Saxon world, give a leading 
role to actors in the market in defining qualifications; 
the state acts as the regulator of the market of relative- 
ly high numbers of qualification. State-regulated corpo- 
ratist skills-formation models, where high-value quali- 
fications are defined by providers in consultation with 
stakeholders from the world of work, are predominant 
in Mediterranean countries such as Spain, France, Italy 
and Turkey. Finally, there are state-regulated skills-for- 
mation systems in which stakeholders from the world 
of work do not yet play an important role. Examples 

Table 5.1: Regulation and the qualifications markets 
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of these can be found in Eastern and South Eastern 
Europe: for instance, in Azerbaijan, and Bosnia and 
Herzegovina. Such models can provide some insight 
as to how existing institutional arrangements can have 
an influence on the institutional and legal setting of 
qualifications frameworks. However, they do not make 
these arrangements predictable. 

These models were developed based on the predominant 
systems of vocational education in Europe, provided by 
predominantly public providers for young people. But un- 
der the influence of global developments and demographic 
changes, lifelong learning systems are emerging, opening 
up what had been virtually state monopolies on qualifica- 
tions. In other words, there are more institutions, and a 
greater range of providers have emerged, such as profes- 
sional bodies, municipalities, private companies, employ- 
ment services, non-governmental organizations (NGOs), 
private schools and international providers, offering differ- 
ent kinds of qualification. This makes it more important to 
regulate qualifications that are offered by different bodies 
for different target groups, in order to reduce the prolifera- 
tion of qualifications, and to protect the interests of citizens 
and employers by strengthening confidence in the value of 
qualifications. 

State-regulated systems are gradually opening up to 
qualifications from the market, but they deal with them 
differently. The tripartite National Commission for 
Professional Certification (CNCP) in France has different 
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approaches to including qualifications in the NQF regis- 
ter (RNCP). The publically provided qualifications under 
the responsibility of the Ministry of Education and recog- 
nized universities have the right to be automatically in- 
cluded in the register (by law). Other qualifications com- 
ing from the market are scrutinized to establish that they 
have been developed on the basis of identified needs, in 
cooperation with stakeholders from the world of work, 
and are not only obtainable through completing a study 
programme, but allow for the validation of non-formal 
learning. These qualifications are classified as on-demand 
from the market. 

In preparing the Polish NQF, careful analysis has been 
made of 'non-formal' qualifications in the country; these 
could come into the NQF in order to recognize adult 
learning. These qualifications can be included in the NQF 
register at the same level as well-established qualifica- 
tions obtained via formal education, if they fulfil certain 
quality requirements, but they cannot provide direct ac- 
cess to formal education at the next level, and are there- 
fore considered ‘partial qualifications'. 

In the Malaysian Qualifications Framework, ‘market qual- 
ifications' have been brought in line by linking them to 
occupational standards, but they are under the remit of 
the Ministry of Human Resources, while the Malaysian 
Qualifications Agency deals with quality-assuring quali- 
fications and provision in the higher education and com- 
munity-college sector (ETF, 2012). 

A major and increasingly important challenge and priority 
is integrating international qualifications. By nature, these 
often have their own logic and structures and their own 
quality assurance processes, and are issued by awarding 
bodies which are well recognized internationally and there- 
fore difficult to bring into the fold of national regulations. 
The qualifications framework in the United Arab Emirates 
(UAE) is trying to deal with these qualifications by bringing 
them under a common quality-assurance and recognition 
system. In the UAE, there is a very high number of foreign 
nationals who have foreign credentials. Moreover, many 
international providers based in other countries operate 
on UAE territory. Gradually, both the foreign provision of 
qualifications in the country and recognition of the inter- 
national workforce are planned to be integrated in a more 
coherent and quality-assured system (nqa.gov.ae). 

In Europe, the European Qualifications Framework Advisory 
Group is still developing a way of dealing consistently with 


international qualifications provided in different member 
states. These cases show that international regulation is still 
on the horizon, rather than imminent. 

While analysing the institutional and legal arrangements, 
another factor to consider is the stage that implemen- 
tation of qualifications system reforms has reached. 
Arrangements are evolving over time. Reforms often 
start with a focus on the development and adaptation 
of structures and standards, in order to set common 
principles and populate the NQF. Roles normally change 
once a critical number of qualifications is reached, with 
the focus shifting to the coherent use of qualifications for 
learning, assessment and certification. At a later stage, 
attention turns to improving the intended impacts in 
terms of access, progression, career development, mobil- 
ity and recognition. 

SCOPE OF LEGISLATION: EXAMPLES IN 
PRACTICE 

In practice, legal arrangements can start from many an- 
gles, but they are often linked with making a specific 
body responsible for the implementation. 

The first relevant piece of legislation in England was 
the act to establish the National Council for Vocational 
Qualifications in 1986, although it took until 2000 be- 
fore the NQF became a reality. The Education Act of 
1989 in New Zealand defined the responsibilities of the 
New Zealand Qualifications Authority. The NQF in South 
Africa started with the South African Qualifications 
Authority Act (No. 58, 1995). In France, the Law on Social 
Modernization (2002) created the National Commission 
for Professional Certification under the authority of the 
ministry responsible for vocational education, which es- 
tablished the NQF through a national register (RNCP). 
In Montenegro, the Law on National Vocational 
Qualifications (2008) preceded the Law on the NQF in 
2010. In Turkey, a Law on the Vocational Qualifications 
Authority (VQA) (5544/2006) was the start, although 
only in the Amendment Law on VQA of 2011 was there 
reference to developing the NQF. In Ukraine, a govern- 
ment decree on the NQF (2011) started the legislative 
process, as it did in Armenia (2011), while, in Croatia, 
a Law on the Croatian Qualifications Framework was 
adopted (2013). 

These first acts often set the objectives, indicate the NQF 
levels and reference special institutions that may have 
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a role in supporting the implementation of the NQF. 
Legislation is important in many countries as the official 
authorization to begin implementation of the framework. 
However, what really counts is not these single acts, but 
how the NQF is starting to filter through in all relevant 
legislation. Without reference to the NQF in other legisla- 
tion, its impact is limited. 

The NQF decree in Ukraine only sets the general objec- 
tives and the ten-level framework. In 2012, however, this 
was followed by legislation on the validation of non-formal 
and informal learning, which was developed further in 2013 
and 2014. A first step to identifying the qualifications to be 
part of the NQF was made in 2014 with a Law on Higher 
Education. Current discussions on a new legislation on edu- 
cation (the previous law dates back to 1991) and on voca- 
tional education should complete this identification process. 

When the NQF features in important legal documents such 
as a new law on education questions as to its status and 
wider implications are raised. The NQF can affect labour 
law as well as education legislation. In Kazakhstan, the 
NQF has gained particular importance since it has been 
adopted as a tool in the labour code. Another indicator of 
the wider legal impact of the NQF can be the timeframe 
within which the legislation is reviewed and improved. In 
Kazakhstan and Georgia, the original acts to adopt NQFs 
are already under revision, though only a short time has 
passed since their introduction. 

Secondary legislation for implementation can cover many 
different issues, including the confirmation and require- 
ments for qualification types, occupational standards and 
subject area benchmarks. The formats of qualification 
standards (including the unit structure and size), the use 
of credits, validation of non-formal and informal learning, 
access and progression requirements, and quality assur- 
ance arrangements all come in addition to NQF levels to 
regulate qualifications and make them more comparable. 

In the beginning of a country's NQF process, the related 
tasks are often divided among existing institutions and 
stakeholders, building on voluntary contributions. In order 
to move from this voluntary approach to a professional ap- 
proach, formal roles and responsibilities need to be identi- 
fied, allocated and endorsed. One area that is particularly 
important in legislation is the institutional arrangements 
and the roles and responsibilities of stakeholders. Existing 
institutional capacities are often insufficient to put the am- 
bitions of the national qualifications system reform policies 


GLOBAL INVENTORY OF NATIONAL AND 
REGIONAL QUALIFICATIONS FRAMEWORKS 


into practice. This applies to the coordination processes, to 
ensuring coherence in approaches, and to quality-assuring 
assessment of qualifications, but, most of all, it applies to 
the lack of capacity to develop sufficient new occupational 
standards, qualifications and training programmes to in- 
fluence delivery. These deficiencies can mean that NQFs 
remain empty promises. Dedicated institutions with com- 
petent staff can speed up implementation. 

IDENTIFYING THE REQUIRED INSTITUTIONS 

The NQF is a tool to bridge different types of providers of 
qualifications (for general education, initial and secondary 
vocational education and training [VET], higher educa- 
tion, professional development and other forms of adult 
learning). This means there is a need for coordination and 
facilitating cooperation between stakeholders. Active in- 
volvement and dialogue between stakeholders increases 
co-ownership of the proposed reforms, helping to trans- 
late policy objectives into measures on the ground. 

There is also a need for quality assurance when dealing 
with a reforming framework. This especially applies to 
the role of the regulator, which should ensure consistent 
design and use of qualifications, and, in particular, quality 
assurance of assessment processes to strengthen trust in 
the competences of qualification holders. 

Different institutions can steer the development of new 
qualifications and the review of existing ones.. 

Many countries have decided to develop sector skill councils 
(SSCs) to support the identification of sectoral skill needs, 
the development of occupational standards, developing and 
reviewing qualifications, the assessment of candidates, the 
identification of companies for work-based learning, funding 
arrangements and other aspects. Table 5.2 gives an over- 
view of some different types of SSC in operation. 

A number of countries in Eastern Europe and Central 
Asia (the Russian Federation, Armenia, Kazakhstan and 
Kyrgyzstan) have established sectoral qualifications frame- 
works under their NQFs, to identify occupational standards 
and sector-specific qualifications. In Kazakhstan, each of 
these sectoral frameworks is legally established under the 
coordination of the line ministry dealing with that sector. 

This division of coordinating, quality assurance and de- 
velopmental functions seems very logical. The coordinat- 
ing function is about bringing stakeholders together on a 
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Table 5.2: Typology of sector skill councils (SSCs) 


TYPOLOGY OF SECTORAL SKILL COUNCILS (SSCS) 

CLASSIFICATION 

SCOPE/NATURE 

KEY CHARACTERISTICS/ 
FEATURES & REMARKS 

COUNTRY 

EXAMPLES 


Focus on one 
economic sector 

Sometimes a national VET council 
operates by covering all sectors at 
national or regional level. 

CZ-RO-FI-DK- 

CA-UK 

TYPE OF 
COVERAGE 

Focus on more than one 
sector (transversal) 

Some SSCs can operate under umbrella 
organizations (e.g. tripartite institutions/ 
bodies). 

FR-SP-BY-DK- 

UK 


Regional approaches 

Ministerial departments/directions; 
agencies for VET quality; national 
qualification bodies/authorities, etc. 

BY-UK-DK- 

FR-NL-RO 



Own resources/staff/expertise (full-time 



Professional bodies 

employees); legal status and permanent 
public and/or private funding (levy/ 

UK-NL-CA 

INSTITUTIONAL 


payroll systems etc.). 


MANDATE 

Working bodies 

Represent different sectoral interest 
groups. Members are employed in 
represented organizations. 

HR 

PROFILE OF 
INITIATOR 

State-Led/Driven 

Policy dialogue/initiator is mainly led/ 
funded by government or state organization 

BY-KG-SG 

Employer-led 

or by employer organizations (or by both). 

UK-IN 

ROLE IN THE 

POLICY-MAKING 

PROCESS 

Decision-making 

The SSCs can be the final decision-makers, 
or can be limited to delivering advice/ 

RO 

Advisory role 

non-binding recommendations on skills 
policies to final decision-making actors. 

HR 


Limited functions 

Ensuring qualitative match between skills 
demand and VET supply. 

SK-FR 

POLICY 


In addition, members extend their 


FUNCTIONS 

Extended functions 

advice/analysis to other policy areas/ 
stakeholders (e.g. VET planning, 
quantitative skill gaps; skill programmes; 
education and business partnerships). 

AU-BD-NL 

LIFELONG POLICY 
COVERAGE 

Initial VET (IVET) 

SSCs can cover IVET, CVET or both. 

FR-PL-SK 

Continuing VET (CVET) 

They can be sectoral in focus or 
transversally oriented, operating at 

SP-SE-BY 


Both (IVET + CVET) 

national or regional levels. 

FI-EE-RO 






Source: Nino Buie, & Jose Manuel Galvin Arribas, ETF, 2014 
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common platform to agree how to develop and implement 
the framework. It is therefore separate from a more tech- 
nical ‘controlling' quality-assurance function, ensuring the 
different actors follow the rules of the game. The develop- 
ment of qualifications is a responsibility that is best del- 
egated to those actors that have an interest in ensuring that 
these qualifications meet the identified needs of the future 
holders. Analysis of the formal functions of eighteen spe- 
cially established institutions that play a role in implement- 
ing qualifications systems reform in a number of European 
Union member states and neighbouring transition coun- 
tries 1 shows that these arrangements are more complex 
than allowed for in the three categories assumed above. 

Most of the institutions analysed were established relatively 
recently. Eleven of the eighteen institutions were established 
after 2010, although three of these are building on the ex- 
perience of similar agencies. Only three institutions were 
established before 2000 (during the late 1990s). The institu- 
tions concerned are either private initiatives (such as NARK, 
the National Agency for Qualifications Development of the 
Russian Union of Industrialists and Entrepreneurs), estab- 
lished as tripartite institutions (such as MYK, the vocational 
qualifications authority in Turkey) or governmental agen- 
cies (such as ANC, the Romanian qualifications authority). 
Governmental executive agencies are in the majority. 

Table 5.3 provides a comprehensive list of the functions 
and task of these agencies. None of them carries out all 
the functions listed below, but seven agencies clearly deal 
with supporting the provision of education and training as 
well as managing the qualifications systems. 

Specialized bodies performing public duties in the space 
between central government and the implementing in- 
stitutions are often more susceptible to change than 
ministries. This is also true of qualifications agencies or 
authorities. All the institutions involved in the first quali- 
fications frameworks have undergone significant chang- 
es; indeed, with the exception of the SQA in Scotland, 
all of them have been restructured and, in many cases, 
replaced by completely new organizations. In England, 


1 Albania (AK-AFPK), Belgium Flanders (AKOV), Croatia 
(ASOO), Georgia (NC EQE), Ireland (QQI), Kosovo (AKK-KS), 
England (Ofqual), Estonia (Kustekoda), Netherlands (SBB), 
Portugal (ANQEP), Russian Federation (NARK), Scotland 
(SCQF partnership, SQA), Slovenia (CPI), Turkey (MYK), 
France (CNCP), Romania (ANC), Ukraine (IPQ). 


GLOBAL INVENTORY OF NATIONAL AND 
REGIONAL QUALIFICATIONS FRAMEWORKS 


NCVQ was replaced by QCA in 1997, which in turn was 
replaced by Ofqual in 2010. In Australia, the AQF Council 
was created in 2008 and abolished in 2014; in South 
Africa, after a review of the NQF, three sub-frameworks 
were established under three quality councils; while in 
Ireland the national qualifications authority, NQAI, and 
the awarding bodies, FETEC and HETEC, merged into 
one organization, QQI. 

CONCLUSIONS 

Many NQFs have a legal basis, and this applies in par- 
ticular to reforming frameworks that are tools for wider 
education, training and/or labour market reforms. The 
degree of regulation is determined by historical, cultural 
and sociopolitical factors. Legislation is often required to 
start NQF implementation, but legislation is an unpre- 
dictable process, and is bound to change during imple- 
mentation. It is recommended that countries start the 
legislative process with broad framework legislation, con- 
firming the objectives, the levels of the NQF and general 
principles, but leave details to secondary legislation that 
can be more easily updated. 

To support the implementation of the NQF, it is impor- 
tant to ensure that capacities are available to meet the 
ambitions of the NQF objectives. Many countries opt to 
establish specialized bodies. These can deal with coordi- 
nation between stakeholders, with regulating and quali- 
ty-assuring qualifications and awarding bodies, and with 
the development of qualifications. In a number of cases, 
these institutions also support the provision of education 
and training. In reality, the functions and tasks of these 
institutions vary and are difficult to predict. The func- 
tions and structures of these supporting bodies alter over 
time, depending on the changing priorities for the imple- 
mentation of the frameworks. 

Apart from enabling legislation and specialized institu- 
tions to support the implementation of the qualifications 
frameworks, dialogue between stakeholders remains one 
of the most important factors in the implementation of 
frameworks. Where an active dialogue exists involving rep- 
resentatives from the world of work and from providers, 
co-ownership of proposed reforms and a shared vision can 
empower stakeholders to act without overly prescriptive 
guidance from the central level, reducing bureaucracy and 
strengthening impact on learners and in the labour market. 

Authors: Arjen Deij and Michael Graham (ETF) 
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Table 5.3: Functions and tasks of qualifications agencies and authorities 


FUNCTION 

TASKS 

FURTHER NQF 
DEVELOPMENT 

• Maintain NQF structures. 

• Prepare policy decisions. 

• Link NQF to occupations in the labour market. 

FACILITATE COOPERATION 
& COORDINATION 

• Formulate agreed positions. 

• Facilitate debate. 

• Address transversal competences. 

• Work with regional and sectoral bodies. 

IDENTIFY NEEDS AND 
SET PRIORITIES 

• Identify new occupations. 

• Organize development/review of occupational standards. 

• Identify qualifications on offer that could enter the NQF. 

• Address proliferation/overlaps of qualifications. 

• Invite stakeholders to develop specific standards/qualifications. 

COMMUNICATE, INFORM 
& ADVOCATE 

• NQF information dissemination at home and abroad, and via a website. 

• Use of common language. 

• Navigation tools. 

INTERNATIONAL 

POSITIONING 

• Align with QF EHEA and EQF. 

• Act as contact point (EQF, European Higher Education Area (EHEA), 
EUROPASS, ENIC/NARIC). 

• Compare international qualifications. 

MANAGE REGISTERS/ 
DATABASES 

• Manage NQF register of qualifications, units, occupational standards, 
awarding bodies, assessment centres, experts, graduates, educational 
programmes, training providers, training companies, teachers and trainers, 
students, issue certificates in order to authenticate. 

ASSISTANCE, CAPACITY- 
BUILDING AND GUIDANCE 

• Support SSCs/professional bodies/awarding bodies with standards and 
qualifications development. 

• Guidance for qualification types, for validation of non-formal and informal 
learning and for training programmes. 

ENSURE AND ENHANCE 
QUALITY 

• Accredit awarding bodies, standards, qualifications, learners. 

• Enhance coherence and relevance of qualifications. 

• Widen access and alternative pathways. 

• Enhance the quality of assessment/assessors/verifiers. 

• Enhance the quality of providers. 

• Monitor and evaluate different actors. 

RESEARCH THE SYSTEM 
FUNCTIONING 

• Assess the impact and effectiveness. 

• Gather systematic feedback. 


• Support internal quality-assurance processes. 


FUNCTION TASKS 


SUPPORT TRAINING • Development of curricula. 

PROVIDERS • Support education and training provision 

• Training of teachers and trainers. 


Source: Arjen Deij r ETF, 2014 
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CHAPTER 6 1 

DEVELOPING WORLD REFERENCE LEVELS OF LEARNING 
OUTCOMES: POTENTIAL AND CHALLENGES 


INTRODUCTION 

We live in a world in which not only people and jobs, but 
also programmes and institutions, are increasingly inter- 
nationally mobile. Qualified people are more mobile as 
they are increasingly able to cross borders in an expand- 
ing global context. Many jobs are also becoming more 
internationalized as world trade and production are in- 
creasingly structured around global value chains (GVCs) 
(OECD, 2012), and as transferable skills and competenc- 
es are identified and agreed on at transnational, regional 
and even global levels. Educational institutions are also 
engaging in international partnerships, and increasingly 
using new information and communication technologies 
to provide alternative ways to deliver education services 
(WTO, 2010). As a direct response to this increased mo- 
bility of people and jobs, and, to some extant, also insti- 
tutions and programmes, there is an increasing call for 
fair and valid recognition of learning at national, regional 
and international levels. 

In 2012, UNESCO organised the Third International 
Congress on Technical and Vocational Education and 
Training (TVET) in Shanghai to debate current trends 
and future drivers of the development of education and 
training. This global dialogue culminated in the Shanghai 
Consensus, which recommended, among other things, 
the development of international guidelines on quality 
assurance for the recognition of qualifications based on 
learning outcomes. This included the proposal that a set 
of world reference levels (WRLs) be considered to facili- 
tate the international recognition of TVET qualifications. 

THE PURPOSE AND ADDED VALUE OF THE WRLS 

Several factors are pushing the establishment of WRLs, 
including the need for international reference points that 
can be used by different organizations across the world 
for better recognizing qualifications. Qualifications have 
traditionally been deeply embedded in specific national 
social and economic contexts and institutional settings. 
While still very important, the specific national charac- 
ter of qualifications has been challenged by the interna- 
tionalization and globalization of labour markets and the 


mobility of people (both learners and workers, including 
migrant workers) and jobs (including outsourcing and off- 
shoring). This is gradually impacting on the way countries 
define, award and recognize qualifications. Qualifications 
today not only define knowledge, skills and competenc- 
es, and any other kind of learning outcomes held by an 
individual, they also take the form of a currency signal- 
ling their value both nationally and internationally (Leney 
et al., 2009). 

The cross-border provision of education and training, and 
the technological developments resulting in increased 
open and distance learning, and online learning, are also 
identified as important aspects of education and train- 
ing's international landscape. International qualifications, 
as well as recognition of types of learning through open 
badges and other new approaches, further deepen the 
need for international reference points. Given the scale of 
the global movement to reform qualifications frameworks, 
as illustrated in this Inventory, international dialogue, co- 
operation and capacity-building in the field of the recog- 
nition of qualifications are increasingly necessary. 

The purpose of the WRLs lies mainly in their potential 
to address these challenges and to fill gaps and provide 
an independent international reference point to which a 
level of learning can be compared (Keevy and Chakroun, 
forthcoming). In this context, a set of WRLs, with the 
clear purpose to describe levels of learning achievements 
across different types of learning on a global level in order 
to promote the recognition of learning in a context where 
both people and jobs have become, and will continue to 
be, increasingly mobile, is more needed than ever. 

The European Qualifications Framework (EQF) has 
started to fill this void in recent years, but it remains a 
European model embedded in EU governance structures, 
and, as a direct consequence, is limited in its ability to 
embrace differences on an international level. A set of 
WRLs can potentially fulfil this purpose, and in a more 
balanced manner. The WRLs can act as generalizable in- 
dicators of levels of learning and a shared hierarchy that 
allows comparisons of any kind of learning or a common 
metric (Keevy and Chakroun, forthcoming). 
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There are numerous illustrations of the added value of 
WRLs. To start with, they will provide a reference point 
for existing recognition methodologies, such as quali- 
fications and qualification frameworks. The develop- 
ment of NQFs and regional qualifications frameworks 
(RQFs) could benefit from internationally agreed refer- 
ence points, including how progression within domains 
is defined. New sectoral frameworks also stand to gain 
from such reference points, as many of these frame- 
works are gaining international traction. As mentioned 
earlier, the internationalization of trade linked to the 
increased mobility of people and jobs, as well as pro- 
grammes and institutions, will also be influenced by the 
development of WRLs. 

The added value of WRLs can also be illustrated through 
their impact on the quality of multinational and interna- 
tional qualifications, many of which at present remain 
completely unregulated, and have the potential to deval- 
ue the entire qualifications system (Cedefop, 2012). The 
WRLs can become neutral and internationally agreed ref- 
erence points, easily understood by the public and imbu- 
ing confidence in the system. 

Another example is in the area of credential evalu- 
ation, where common international reference points 
can be used to strengthen existing methodologies. 
This also applies to the shift toward learning out- 
comes and the need for a common language. Other 
examples include the move towards representation, a 
concept that, though including qualifications, is not 
limited to them, but attempts to improve transparen- 
cy by providing more information related to learning. 
It is gradually gaining traction, as is evident with the 
Europass CV and Skills Passport (see Bjornavold and 
Coles, 2010). 

WRLs also have the potential to advance the recog- 
nition of non-formal and informal learning (RNFIL) by 
promoting a comprehensive coverage of all forms of 
learning: formal, non-formal and informal. They could 
raise the profile of promising recognition practices 
among stakeholder groups, and highlight the ineffi- 
ciencies caused by barriers to recognition. In sum, the 
WRLs should broadly aim at supporting the mobility of 
learners and workers, and their participation in labour 
markets and lifelong learning. They could facilitate eq- 
uity in recognition by including quality-assurance prin- 
ciples while addressing the challenges of inter-regional 
mobility. 
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DEVELOPMENT PROCESS OF THE WRLS AND 
POSSIBLE COMPONENTS 

Work on the WRLs is at an early stage. UNESCO adopted 
a four-staged incremental approach to respond to the 
Shanghai Consensus recommendationecommendation: 
(1) a technical review of level descriptors at national and 
regional levels, (2) conceptual development of the WRLs, 
(3) broad consultation, and (4) a political process that will 
explore the technical and legal aspects relating to the 
desirability of defining and adopting WRLs (Chakroun, 
2013). 

The WRLs are expected to build on and complement 
the substantial work conducted so far at both national 
(NQFs) and regional level (RQFs). 

Based on the first consultations and preliminary work con- 
ducted (Chakroun, 2013; Keevy and Chakroun, forthcom- 
ing), there is an agreement that a set of WRLs and the 
process of their development need to be more than just a 
technical structuring of levels. The work could start with a 
bottom-up process where the networking of organizations 
and actors developing and implementing RQFs is used as a 
basis for developing a platform for dialogue and coopera- 
tion with a view to exploring areas where WRLs can add 
value to these ongoing efforts. These efforts are, in most 
cases (see the chapters on RQFs in this Inventory ), driven 
by regional integration political agendas. The WRLs could 
encompass several components, including: 

• a set of level descriptors 

• international guidelines concerning quality 
assurance of certification 

• guidelines and orientation resources. 

SET OF LEVEL DESCRIPTORS 

Given the diversity of country contexts, it is remarkable how 
much consensus exists around the world that the recogni- 
tion of learning is increasingly being facilitated by the de- 
velopment and implementation of qualifications frameworks 
based on learning outcomes within a broader lifelong learn- 
ing perspective. Hierarchies of level descriptors, purposefully 
developed to allow for the alignment of qualifications, form 
an important component of this international trend. 

At present, qualifications frameworks exist in various dif- 
ferent forms. These range from sectoral frameworks that 
function within a specific country or across countries, to 
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Table 6.1: Levels and domains across a selection of transnational qualifications frameworks 


EQF LEVEL DESCRIPTOR DOMAINS (8 LEVELS) 


KNOWLEDGE 

SKILLS 

COMPETENCE 

Factual and/or theoretical 

Cognitive; practical 

Autonomy; responsibility 


ASEAN LEVEL DESCRIPTOR DOMAINS (8 LEVELS, IN PROGRESS) 

KNOWLEDGE AND 
COMPREHENSION 

WORK COMPETENCES 

RESPONSIBILITY AND 
ACCOUNTABILITY 

Facts and theories; skills used, such 
as practical and cognitive skills 

Application of knowledge; 
application of skills 

Degree of independence; capacity 
to make decisions and take respon- 
sibility for oneself and others 


SADC LEVEL DESCRIPTOR DOMAINS (10 LEVELS) 

KNOWLEDGE 

SKILLS 

AUTONOMY AND 
RESPONSIBILITY 

Factual and/or theoretical 

Cognitive; practical 

Activity under supervision; respon- 
sibility for outcomes of activity 


vussc* 

TRANSNATIONAL QF LEVEL DESCRIPTOR DOMAINS (10 LEVELS) 

KNOWLEDGE AND 
UNDERSTANDING 

SKILLS 

WIDER PERSONAL AND 
PROFESSIONAL COMPETENCES 

Range of knowledge; 
understanding 

Use knowledge, understanding 
and skills 

Responsibility; decision-making 


CARICOM QF (8 LEVELS + 2 ACCESS) 

KNOWLEDGE AND 

LIFE SKILLS, APPLICATION AND 

COMPETENCES 

UNDERSTANDING 

PRACTICE 


Theoretical and/or factual; 

Abilities for adaptive positive 

Communication, numeracy and 

the ability to recall and present 

behaviour; cognitive and practical 

ICTs; autonomy, accountability, 

information 


working with others 


Source: Keevy, J and Chakroun, B. Forthcoming. Levelling and Recognizing Learning Outcomes. 
The Use of Level Descriptors in the Twenty-First Century. Paris, UNESCO 


Virtual University for Small States 
of the Commonwealth. 
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NQFs which are probably the best known, to transna- 
tional qualifications frameworks (TQFs), which include 
RQFs. All types of qualifications framework use level de- 
scriptors based on learning outcomes, to define a set of 
hierarchical levels across a series of domains. 

Three domains are found in the majority of level descrip- 
tors of qualifications frameworks, including sectoral, 
national and transnational examples. The first is knowl- 
edge: this is probably the best understood domain and is 
well articulated across the case studies presented in this 
Inventory. The domain is primarily about the ability to 
use knowledge and understanding, and not the applica- 
tion of knowledge. 

The second most widely used domain is skills. Similar to 
the knowledge domain, skills are about potential abil- 
ity and not application: in this case, the ability to apply 
knowledge in relation to a job or specific task. This do- 
main is also widely used and reasonably well understood, 
although some overlap with the knowledge domain is 
apparent, and, as a result, knowledge and skills are com- 
bined in some instances (as in the ASEAN RQF and the 
Pacific RQF [PRQF]). 

The third domain, competence, is about the application 
of knowledge and skills. Of the three domains, compe- 
tence is the broadest in that several sub-domains are 
used. In this regard, three main interrelated sub-domains 
can be identified: applied competence (the application of 
knowledge and skills in a specific context, which includes 
foundational, practical and reflexive aspects), core/key 
competence (the sum of skills needed to live in a con- 
temporary knowledge society: Cedefop, 2008), and af- 
fective competence (the application of knowledge and 
skills in relation to personal, behavioural and attitudinal 
dimensions). In this context, the notion of competence 
is interpreted in diverse ways across different traditions 
and contexts. 

Even in cases where the knowledge, skills and compe- 
tences domains are not explicit, elements of each can 
be recognized in the level descriptors. All three domains 
are based on learning outcomes, although the influ- 
ence of the lifelong learning discourse and the move 
towards knowledge-based economies is more evident 
in the knowledge and skills domains. The competence 
domain shows remnants of the competency-based ap- 
proach that was dominant in twentieth-century TVET 
discourse. 
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Drawing on the work of Keevy and Chakroun (forthcom- 
ing) and the present international inventory of NQFs de- 
veloped by Cedefop, the European Training Foundation 
(ETF), UNESCO and the UNESCO Institute for Lifelong 
Learning (UIL), Table 6.1 provides elements of compari- 
son. For instance, NQFs and RQFs use variations of do- 
mains in their level descriptors: in a few instances (such 
as in the ASEAN RQF), the domains of knowledge and 
skills are collapsed into a single domain. In many cases 
(for example CARICOM), the competence domain con- 
tains sub-domains or specializations that overlap with the 
knowledge and skills domains. Different variations of do- 
mains are found across recognition methodologies other 
than qualifications frameworks. 

While there is still a long road to be taken to develop 
the WRLs, it is proposed that they be based on the 
domains given in Table 6.2 (with sub-domains) as a 
basis for the formulation of its level descriptors. The 
sub-domains listed here could be simplified following 
some testing. 

Trust in qualifications plays a crucial role for people across 
the world. The certification process becomes particularly 
important in this context, and quality-assurance mech- 
anisms are essential to ensure that these processes ef- 
fectively generate credibility and trust. The importance 
of quality assurance of certification is stressed in sever- 
al NQFs and RQFs (such as the EQF, ASEAN RQF and 
PRQF) presented in this Inventory. However, there is no 
common definition of the ‘certification process' across 
the world. 

The primary objective of the envisaged international 
guidelines concerning quality assurance of certification 
is to present to member states and interested organiza- 
tions a glossary of terms and a range of instruments, 
methods and tools they can work with to develop by 
themselves arrangements for the quality assurance of 
certification. 

The guidelines will be designed as means to strengthen 
the comparability and transparency of approaches to the 
quality-assurance of certification and methods across na- 
tional boundaries. These objectives reflect the overall ob- 
jective of giving value to qualifications acquired abroad. 
Essentially, the guidelines should be seen as an evaluative 
tool for those involved with quality assurance of certifi- 
cation at national, regional and transnational levels. The 
level of prescriptiveness of the guidelines will depend on 
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the form of the proposed WRLs. Their impact will rely 
mainly on their relevance and ability to add value at na- 
tional or regional levels. 

To advance work on the international guidelines, UNESCO 
in 2015 commissioned a global study of quality-assurance 
arrangements that underpin the certification process. The 
study will analyse and compare policies and mechanisms, 
identifying success factors and constraints, based on the 


Table 6.2: Domains to be considered in the WRLs 


review of existing evidence and on country and regional 
case studies. The findings will be used to develop the 
international guidelines. 

GUIDELINES AND ORIENTATION RESOURCES 

Around 140 countries are developing NQFs, while 
at least six regions are engaged in developing RQFs. 
Mutual and peer learning and capacity-development 


DOMAIN 

DEFINED AS 

SUB-DOMAIN 

DEFINED AS/COMMENTS 

KNOWLEDGE 

The ability to 
recall and present 
information 

No explicit 
sub-domains are 
proposed 

The existing categorizations and forms of 
knowledge can be accommodated in the 
broad domain, as is the current practice; this 
decision could be reviewed at a later stage. 



FOUNDATION 

Skills which emphasize literacy and 
numeracy. 


The ability to 
do in context 


The application of universal knowledge 
and skills across a range of social, work and 

SKILL 

TRANSFERABLE 

geographical settings. This domain may at 
a later stage be further developed into a 
separate domain. 




TECHNICAL AND 
VOCATIONAL 

The specific technical know-how to do jobs. 




Includes foundational competence which 
focuses on intellectual/academic skills of 



APPLIED 

knowledge; practical competence which 



COMPETENCE 

focuses on the operational context; and 
reflexive competence which focuses on 
learner autonomy. 


The application 



COMPETENCE 

of knowledge and 
skills in context 

AFFECTIVE 

Personal, behavioural and attitudes 
competences that include a specific focus 



COMPETENCE 

on those competences that may be best 
assessed collectively. 


Source: Keevy, J and Chakroun, B. Forthcoming. Levelling and Recognizing Learning Outcomes. 
The Use of Level Descriptors in the Twenty-First Century. Paris, UNESCO 



58 


VOLUME I - THEMATIC CHAPTERS 


should be encouraged and supported through initiatives, 
networks and countries. Substantial learning is already 
taking place through the UNESCO-UNEVOC e-forum 
and the ETF Qualifications Platform. It is very necessary, 
however, to scale up this learning and develop more ap- 
propriate guidelines and resources to be used for capac- 
ity-building, drawing on the experiences gained through 
regional processes (Europe, ASEAN, Caribbean and oth- 
ers) and the numerous existing initiatives. Cedefop, ETF, 
UNESCO and UIL can join forces to develop appropri- 
ate guidelines and resources. The UNESCO-UNEVOC 
International Centre, in partnership with other similar in- 
stitutions such as the ILO Centre in Turin, will be able to 
use the guidelines and orientation resources to plan and 
organize these capacity-building initiatives. 
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CONCLUSION 

Clearly, there is still much to be done before a set of WRLs 
is in place and widely used. As mentioned earlier, UNESCO 
adopted a four-staged incremental approach which care- 
fully considers the importance of political legitimacy and 
the credibility of such an international reference tool. 
There is also a need for building a broad agreement about 
how WRLs will add value to what is now offered by NQFs 
and RQFs. In this context, the issue is not so much the 
technical structuring of the WRL as the consultation, in- 
stitutional and political processes underpinning them. 
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CONCLUSIONS 

GLOBAL PROGRESS IN NQF DEVELOPMENT SINCE 2013 


We noted in our 2013 edition the worldwide surge in 
national qualifications frameworks (NQFs), which had 
reached more than 140 countries. This figure now ex- 
ceeds 150. While only a handful of frameworks had been 
established before the millennium, the big expansion took 
place between 2008 and 2012. The United Nations rec- 
ognizes 193 sovereign states, so NQF coverage extends to 
approximately three in four countries. The concentration 
is greatest in Europe, where only the continent's tiny sur- 
viving city-states or principalities remain outside the NQF 
network, with the European Qualifications Framework 
(EQF) its hub. Most NQFs worldwide are comprehensive 
frameworks, covering all types and levels of qualification, 
while some are partial, covering only vocational educa- 
tion and training (VET), for example. 

Regional qualifications frameworks (RQFs) are the other 
main type of framework, and here too we see most re- 
gions of the world developing a meta-framework to link 
the national frameworks. 

Progress in developing and implementing NQFs since 
then has been variable across countries, unsurprisingly. 
Implementation is always more difficult than design, of 
course, but the speed of development of NQFs can also 
be influenced by specific national or regional circum- 
stances which may not be confined to the NQFs them- 
selves. These include wider political and economic factors 
such as ongoing upheaval in the Arab world. 

But NQFs are now an established policy practice globally, 
and, in the countries cited here, they are an integral part 
of their country's qualifications and wider education and 
training system. 

Measuring progress is a rule-of-thumb business, but we 
can approximately define the development stages thus: 
design and development; formal stages (such as legisla- 
tion and formal adoption); the early operational phase; 
and consolidation or advanced implementation. In the 
European Union, countries are divided among the for- 
mal, early operational and advanced stages, the biggest 
number being concentrated in the early operational stage. 
In the broader neighbourhood of the European Union, an 
area covered by the European Training Foundation (ETF) 


in this publication, most are in one of the design and de- 
velopment, formal or early operational stages. 

Reaching the last' stage is not the end of the story. 
NQFs are never finished, and we know from the estab- 
lished first-generation NQFs in New Zealand, the United 
Kingdom, Ireland and other countries that the process, 
once mature, is cyclical, a pattern of establishment, im- 
plementation, review and modification, then more imple- 
mentation of the revised elements of the NQF. 

We also believe that NQFs cannot simply be divided 
into either reforming or communicating categories. In 
many countries, especially transition or developing so- 
cieties, the reform goal is explicit and uncontroversial, 
in any case. However, some EU countries, for example, 
can be reluctant to acknowledge openly this aim. But 
our findings point to a more complex reality. While the 
EQF may, initially at least, have caused some countries in 
the European Union to set up NQFs primarily to link to 
the EQF, in practice even the NQFs in the pre-2004 EU 
countries do initiate reform, especially through introduc- 
ing learning outcome approaches. 

IMPACTS OF NQFs - DRILLING DOWN 

Assessing progress inevitably begs the question of what 
impact NQFs have had. That the countries cited have in 
most cases progressed since 2013 has allowed us to look 
more deeply into changes effected by NQFs, to assess 
their impacts. 

We have looked more broadly - at the level of a national 
education and training system - and narrowed the focus, 
on the more immediate area of qualifications and their 
surrounding infrastructure: for example, definitions of 
qualifications, links with occupational standards, quality- 
assurance systems in qualifications, and governance of 
qualifications systems. 

The link between progress and impact in NQFs is learn- 
ing outcomes. When we look at all the declared aims and 
functions of NQFs, their whole value - and by exten- 
sion the weight behind any impact - hinges on learning 
outcomes. 
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NQFs imply outcomes across the system, via occupation- 
al standards and curricula. That said, countries describe 
outcomes for NQF levels and the qualifications within 
them differently, sometimes stating them broadly or, in- 
deed, directly taking them from a RQF such as the EQF, 
or setting them out in more detail and adding additional 
categories of descriptor to fit the national context. 

In the countries covered here, NQFs and qualifications re- 
forms are linked. In most cases, the NQF is the principal 
tool, or system, to effect the reform. One effect of NQFs 
has been to generate a consensus on what the common 
elements and characteristics of a qualifications system 
should be. These include a basis in learning outcomes; 
some form of occupational analysis, such as occupational 
standards, to achieve labour-market relevance; flexible 
paths and delivery, such as the use of units and recogni- 
tion of prior learning (RPL); the separation of qualifica- 
tions from curricula, with the former providing the start- 
ing point for system planning; engaging with stakeholders 
to improve relevance; and quality-assurance mechanisms. 

The EQF has accelerated development of NQFs in the 
European Union and its neighbourhood (which together 
comprise over fifty countries), as countries seek to com- 
pare and link their qualifications system to Europe, but 
it has also set the basic template from which all NQFs 
are designed. Rather like the bicycle, the basic design - 
usually with eight levels and three or more columns of 
descriptors - does not vary much. However, as we said in 
the first edition, this can be a deceptively simple under- 
standing of NQFs. In practice, national contexts, needs 
and implementation arrangements do vary greatly. 

Notwithstanding some scepticism about the impacts of 
NQFs, it is worth noting that no country has repealed 
or abolished its NQF. A few have drastically revised the 
arrangements for implementing their NQF, but none has 
abandoned an NQF altogether. 

LOOKING TO 2017: NATIONAL TO REGIONAL TO 
GLOBAL: LINKING THE WORLD? 

While most countries covered here have made with: a 
start in developing their NQFs, many have not moved on 
from discussions or blueprints. Where NQFs are legally 
adopted they often remain void of actual qualifications. 

The key challenges are to reform curricula on an outcomes 
basis; to engage stakeholders (which too often remains 
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patchy rather than systemized in sector skills councils); 
more varied and modernised assessment to take account 
of outcomes-based qualifications; and a wider applica- 
tion of quality assurance to validation of qualifications 
and assurance of assessment. 

In essence, it is a matter of integrating the NQF with the 
national qualifications system, and, in turn, using the 
NQF to influence the wider education and training sys- 
tem to provide lifelong learning in practice. 

Emerging issues in many countries are to determine the 
place - whether they belong in an NQF or not, in sub- 
stance - of international qualifications produced by com- 
panies such as Cisco and Microsoft, and sector-specific 
qualifications such as maritime and welding qualifica- 
tions; and the opening of qualifications frameworks to 
accommodate non-formal qualifications, such as those 
from industry, on a national level. 

Nationally, NQFs structure and coordinate a qualifica- 
tions system. Internationally, they provide an identifiable 
entry point to a qualifications system, and, therefore, a 
potential link to other countries' systems. While the EQF 
is arguably the most established of RQFs it is not the 
only such reference point. The regional equivalents in the 
Caribbean, Asia-Pacific and Africa are increasingly influ- 
ential. RQFs greatly simplify linking between countries, 
acting as one common reference where the alternative 
might be a mass of confusing bilateral links. 

At world level, governments, international institutions 
and other bodies, coordinated by UNESCO, are discussing 
how to develop world reference levels. Given the interna- 
tional situation detailed in this publication, it does seem 
to be the next step to have, in one form or another, some 
type of world reference or framework. 

Our global village seems to require this. We are a world 
on the move as never before, and qualified people are 
the most mobile, able more easily to cross borders. Jobs 
themselves are becoming internationalized as world trade 
and production become structured around global value 
chains, and as common transferable skills and compe- 
tences are increasingly identified at regional and global 
level. Some education and training institutions are in the 
vanguard of this trend, offering training programmes via 
new communication technologies. There is a need to of- 
fer fair and valid recognition for qualifications gained in 
this way, at home, abroad and globally. 
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We are scanning the horizon now, but what might such 
an international system or framework look like? A neces- 
sary condition is a common conceptual basis, which can 
only rest on learning outcomes. World reference levels 
of learning outcomes would provide a neutral and inde- 
pendent reference point against which a level of learning 
can be assessed. They would support mobility, partici- 
pation in the labour market and lifelong learning. They 
would need to be supported by agreed quality-assurance 
principles, whose level of specificity will need to be deep 
enough to be meaningful at the level of an individual 
qualification, but broad enough to be globally shared. 
These all require agreements between (preferably) most 
governments in the world. At a technical level, expert 
bodies would need to devise guidance materials and co- 
operate in implementation through advisory bodies. 

Our next edition, scheduled for 2017, will undoubtedly 
have more to report on these issues. 
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